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Sir: 

Appellants are filing this Appeal Brief in support of 
their appeal from the final rejection of claims 1, 2, 4-7, 13- 
15, 17-20, 26-28, 30-33, 39-45, 47 and 52-59 in the final Office 
Action dated August 9, 2007 ("Final Office Action") . A Notice 
of Appeal for this case was filed on December 5 f 2007. 

In view of the arguments and authorities set forth 
below, the Board should find the rejection of claims 1, 2, 4-7, 
13-15, 17-20, 26-28, 30-33, 39-45, 47 and 52-59 to be in error, 
and the Board should reverse the rejection. 
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(i) Real Party in Interest 

Appellants respectfully advise the Board that the real 
party in interest in the above -identified patent application is 
United Video Properties, Inc., a corporation organized and 
existing under the laws of the State of Delaware, and having an 
office and place of business at 6922 Hollywood Boulevard, Los 
Angeles, CA 90028, which is the assignee of this application* 

(ii) Related Appeals and Interferences 

Appellants respectfully advise the Board that there 
are no other appeals or interferences known to appellants, their 
legal representative, or their assignee that will directly 
affect or be directly affected by or have a bearing on the 
Board's decision in the pending appeal. 

(iii) Status of Claims 

Claims 3, 8-12, 16, 21-25, 29, 34-38, 46 and 48-51 
have been canceled. Claims 1, 2, 4-7, 13-15, 17-20, 26-28, 30- 
33, 39-45, 47 and 52-59 are finally rejected in this application 
and are on appeal. 

Claims 1, 2, 4-7, 13-15, 17-20, 26-28, 30-33, 39-45, 
47 and 52-59 are pending in this application. 

(iv) Status of Amendments 
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Appellants have not submitted any amendments pursuant 
to 37 C.F.R. § 1.116 or in reply to the Final Office Action, 
from which this appeal is being sought, 

(v) Summary of Claimed Subject Matter 

Appellants' independent claims 1, 14, 27, and 40 relates to a 
method, systems, and machine -readable media for providing help 
information that explains to a user how an electronic television 
program guide operates. See, e.g., specification, page 21, 
lines 14-28. The current operating mode of the electronic 
television program guide is tracked and stored as the user 
operates the guide. See, e.g., specification, page 21, 
line 34 -page 22, line 3* A user input is received and in 
response to the user input, the help information that explains 
how the electronic program guide operates is provided. See, 
e.g., specification, page 22, lines 3-6. The help information 
that is provided is based on the stored current operating mode 
of the guide. See, e.g., specif ication, page 22, lines 3-6. 

(vi) Ground of Rejection to be Reviewed on Appeal 

The grounds of rejection to be reviewed on this appeal 
are the final rejection of claims 1, 4-5, 13-14, 17-18, 26-27, 
30-31, 39-40, 42-43, 47 and 52-59 under 35 U.S.C. § 103(a) as 
being unpatentable over Young in view of Richards, and the final 
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rejection of claims 2, 6-7, 15, 19-20, 28, 32-33, 41, and 44-45 
under 35 U.S.C. § 103(a) as being unpatentable over Young in 
view of Richards , and further in view of Palmer . 

(vii) Argument 

A. The requirements for a prima facie 
obviousness rejection have not been met 

To establish prima facie obviousness, all of the claim 
limitations must be taught or suggested by the prior art. In re 
Wilson, 424 F.2d 1382, 1385, 165 USPQ 494, 496 (CCPA 1970). 
"All words in a claim must be considered in judging the 
patentability of that claim against the prior art." 

In the rejection of claims 1, 14, 22 and 40 over Young 
in view of Richards, the Examiner concedes that Young fails to 
teach appellants' claimed feature of "tracking and storing a 
current operating mode of the electronic program guide as the 
user operates the electronic television program guide," and 
providing help information based on the stored current operating 
mode (Office Action, page 6) . The Examiner then attempts to 
find this claim feature in Richards. 

Contrary to the Examiner's contention, however, 
Richards also fails to teach this feature of appellants 1 claims. 

B. The combination of Young and Richards does not 
disclose "tracking and storing a current operating 
mode ... of the guide as the user operates" 
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The Examiner contends that Richards discloses tracking 
and storing a current operation mode as the user operates the 
electronic program guide. 

As an initial matter, the Examiner cites almost three 
quarters of the specification, excluding the programming 
specifications ("figs. 1-4 f col, 1, 1, 61-col. 2, 1. 61 , col- 3, 
1. 1-COl. 4, 1. 33, COl. 5, 11. 8-25, 1. 46-COl. 6, 1. 9, 
col. 7, 1. 7-47 and 47-col. 8, 1. 1+," see Office Action, p. 6) 
without specifically pointing to disclosure showing how the 
Richards system tracks and stores an operating mode as the user 
operates the guide. Appellants have scoured the reference and 
have too failed to identify any disclosure suggesting that 
Richards operates as required by appellants' claims. 

In fact, Richards does not operate as contended by the 
Examiner. Contrary to appellants' claimed approach, in which 
the guide tracks and stores the operating mode to provide 
immediate access to contextual help information, the Richards 
system does not always know the current mode of the system. 
Instead, the Richards system provides three different levels of 
help by determining current system variables upon receiving a 
help request, and providing help associated with the determined 
system variables . 
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First level help is provided in response to the user 
pressing the Help key once (col. 7, 11. 25-26) . In response to 
the user interaction, a help message that relates to the box or 
panel located under the pointer is provided (col. 7, 11. 26-29) . 
Unlike other levels of help, the first level help is "provided 
by the application concerned" (col. 7, 11. 34-35) without first 
identifying or setting system variables (e.g., col. 8, 11. 55- 
62) . Thus, because the application providing the first level 
help does not identify or set system variables, it cannot track 
and store a current operating mode of the system -- the 
application cannot inherently know, much less track and store 
the overall system variables without being told by the system. 
Accordingly, the first level help provided by Richards does not 
operate by tracking and storing a current operating mode of the 
system as the user operates the system. 

Second level help is provided when the user presses 
the Help key twice (col. 7, 11. 36-40). In response to 
detecting that the Help key was pressed twice, the application 
requesting help calls a Help application and moves to its QUEUE 
block, which sets system variables (i.e., S .Help. Facility, 
S. Help. Application, S.Help. Panel and S.Help. Box) (col. 8, 11.59- 
63, cols. 45-46, 11. 13-17). To set the system variables, the 
QUEUE block calls a DETSUBJECT procedure, used to determine the 
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subject for which help is provided (cols, 45-46, 1. 19) . The 
DETSUBJECT procedure examines the appropriate variables for data 
passed from the QUEUE block , and sets the "variables ' FacName, 1 
'AppName, ' 'PanName, ' and 'BoxName'" to the facility, 
application, panel and box for which help has been requested 
(cols. 21-22, 11. 6-ll r 11. 17-21). The QUEUE block then 
identifies and displays help information based on the set 
variables using a SETPOINTERS procedure that "determines the 
name of the datastore in which Help for the required subject 
will be found, and sets up pointers to the columns in the help 
index and the help text tables in the datastore" (cols 35-36, 
1. 29-COls. 37-38, 1.2). 

Thus, second level help is provided by determining, in 
response to receiving the request for second level help and only 
at the time the request is received , the facility, application, 
panel and box of the application for which help is requested. 
Accordingly, the Richards system does not track and store an 
operating mode as the user operates the system to provide second 
level help, but rather identifies, upon request, system 
variables used for providing the help based on the known current 
facility, application, panel and box for which help was 
requested. 
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Third level help is provided in response to a user 
selecting a "Tutorial" box in the help window, after having 
first viewed second level help (col, 7, 11, 63-65), In response 
to selecting the "Tutorial" box (e.g., identified by the SELECT 
block of the Help application, cols, 49-50, 11. 14-22), the 
TUTSELECT procedure is called. The TUTSELECT procedure sets up 
the variables used to pass the subject for the tutorial and 
starts the HelpTut task, which provides a tutorial for the user 
on the specified subject (cols. 19-20, 11. 11-15; cols. 41-42, 
11. 7-12). Thus the third level help uses the context of the 
second level help to provide the appropriate tutorial. 
Accordingly, third level help is not provided in response to 
tracking and storing a current operation mode as the user 
operates the system, as required by appellants' claims, but 
rather provided by identifying, upon request to access third 
level help, the appropriate system variables. 

In view of the foregoing, Richards and Young, whether 
taken alone or in combination, fail to show or suggest "tracking 
and storing the current operating mode of an electronic 
television program guide as a user operates the guide" and 
"providing help information based on the stored current 
operating mode," as required by appellants independent claims 1, 
14, 27, and 40. Accordingly, appellants respectfully submit 
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that the Examiner has not established prima facie obviousness, 
because the prior art references, when combined, fail to teach 
or suggest all of the claim limitations (MPEP § 2143) . 

C. The dependent claims are patentable for at least the 
reasons that the independent claims are patentable 

If an independent claim is nonobvious under 35 U.S.C. 

103, then any claim depending therefrom is nonobvious. In re 

Pine, 837 F.2d 1071, 5 USPQ2d 1596 (Fed. Cir, 1988) . 

Accordingly, appellants submit that dependent claims 2, 4-7, 13, 

15, 17-20, 26, 28, 30-33, 39, and 41-45, 47, and 52-59 are found 

allowable over Young, Richards and Palmer, whether taken alone 

or in combination, for at least the reasons that independent 

claims 1, 14, 27 and 40 are patentable over Young and Richards, 

whether taken alone or in combination. 

D. Conclusion 

For the foregoing reasons, appellants submit that 
Young and Richards, whether taken alone or in combination, do 
not render unpatentable any of appellants' claims 1, 4-5, 13-14, 
17-18, 26-27, 30-31, 39-40, 42-43, 47 and 52-59. Appellants 
further submit that Young, Richards and Palmer, whether taken 
alone or in combination, do not render unpatentable any of 
appellants' claims 2, 6-7, 15, 19-20, 28, 32-33, 41, and 44-45. 
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The Final Office Action's rejections of these claims under 35 
U.S.C. § 103(a) should therefore be reversed. 

This Brief has the following appendices: 

(viii) Claims Appendix 

Appendix A: Copy of claims 1, 2, 4-7, 13-15, 17-20, 
26-28, 30-33, 39-45, 47 and 52-59 involved in this appeal; 

(ix) Evidence Appendices 

Appendix B: Copy of the final Office Action dated 
August 9, 2007; 

Appendix C: Copy of Young et al. U.S. Patent 
NO. 4,706,121 ("Young"); 

Appendix D Copy of Richards et al. U.S. Patent 
No. 5,179,654 ("Richards"); and 

Appendix E Copy of Palmer et al. U.S. Patent 
No. 6,320,588 ("Palmer"). 

(x) Related Proceedings Appendix 

None, 

III. Conclusion 

In view of the foregoing, claims 1, 2, 4-7, 13-15, 17- 
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20, 26-28, 30-33, 39-45, 47, and 52-59 are in condition for 
allowance. This application is therefore in condition for 
allowance. Reconsideration and allowance of the application 
respectfully requested. 



Respectfully submitted, - 

/Paul E. Leblond/ 

Paul E. Leblond 
Registration No. 58,397 
Agent for Appellants 
Ropes & Gray LLP 
Customer No. 75563 
1211 Avenue of the Americas 
New York, New York 10036 
Tel.: (212) 596-9000 
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APPENDIX A: Listing of claims involved in the appeal 
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Listings of Claims: 

1. (Previously presented) A method for providing 
help information that explains to a user of an electronic 
television program guide how the electronic television program 
guide operates, the method comprising: 

tracking and storing a current operating mode of 
the electronic program guide as the user operates the electronic 
television program guide, wherein the electronic television 
program guide has a plurality of operating modes; 

receiving a user input; and 

providing help information that explains to the 
user how the electronic television program guide operates in 
response to receiving the user input, wherein the help 
information provided is based on the stored current operating 
mode. 

2. (Previously presented) The method defined in 
claim 1 further comprising: 

displaying a help icon using the electronic 
television program guide, wherein receiving the user input 
comprises receiving a user selection of the help icon. 

3 . (Canceled) 
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4. (Previously presented) The method defined in 
claim 1 wherein providing help information comprises displaying 
the help information in response to the user input, wherein a 
user depressing a help key on a remote control generates the 
user input. 

5. (Previously presented) The method defined in 
claim 1 wherein providing help information comprises displaying 
a text message that explains to the user how a portion of the 
electronic television program guide operates. 

6. (Previously presented) The method defined in 
claim 1 wherein providing help information comprises displaying 
an instructional video that explains to the user how a portion 
of the electronic television program guide operates. 

7. (Previously presented) The method defined in 
claim 1 wherein providing help information comprises playing an 
instructional audio program that explains to the user how a 
portion of the electronic television program guide operates . 

8-12. (Canceled) 
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13, (Previously presented) The method defined in 
claim 1 further comprising: 

storing the help information in a memory; and 
retrieving the help information from the memory 
in response to receiving the user input. 

14. (Previously presented) An electronic television 
program guide system that provides help information for 
explaining to a user of an electronic television program guide 
how the electronic television program guide operates, the system 
comprising: 

means for tracking and storing a current 
operating mode of the electronic program guide as the user 
operates the electronic television program guide, wherein the 
electronic television program guide has a plurality of operating 
modes; 

means for receiving a user input; and 
means for providing help information that 
explains to the user how the electronic television program guide 
operates in response to receiving the user input, wherein the 
help information provided is based on the stored current 
operating mode. 
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15. (Previously presented) The system defined in 
claim 14 further comprising: 

means for displaying a help icon using the 
electronic television program guide wherein receiving the user 
input comprises receiving a user selection of the help icon. 

16 . (Canceled) 

17. (Previously presented) The system defined in 
claim 14 wherein the means for providing help information 
comprises means for displaying the help information in response 
to the user input, wherein a user depressing a help key on a 
remote control generates the user input. 

18. (Previously presented) The system defined in 
claim 14 wherein the means for providing help information 
comprises means for displaying a text message that explains to 
the user how a portion of the electronic television program 
guide operates . 

19. (Previously presented) The system defined in 
claim 14 wherein the means for providing help information 
comprises means for displaying an instructional video that 
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explains to the user how a portion of the electronic television 
program guide operates. 

20. (Previously presented) The system defined in 
claim 14 wherein the means for providing help information 
comprises means for playing an instructional audio program that 
explains to the user how a portion of the electronic television 
program guide operates. 

21-25. (Canceled) 

26. (Previously presented) The system defined in 
claim 14 further comprising: 

means for storing the help information; and 
means for retrieving the help information from 
the means for storing in response to receiving the user input. 

27. (Previously presented) An electronic television 
program guide system that provides help information for 
explaining to a user of an electronic television program guide 
how the electronic television program guide operates, the system 
comprising: 

a video display generator; 
a remote controller; 
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a microcontroller; and 

an electronic television program guide executed 
by the microcontroller and programmed to (1) track and store a 
current operating mode of the electronic program guide as the 
user operates the electronic television program guide, wherein 
the electronic television program guide has a plurality of 
operating modes, (2) receive a user input and (3) provide help 
information that explains to the user how the electronic 
television program guide operates to the video display generator 
for display in response to receiving the user input, wherein the 
help information provided is based on the stored current 
operating mode. 

28. (Previously presented) The system defined in 
claim 27 wherein the electronic television program guide is 
further programmed to: 

provide a help icon to the video display 
generator for display; and 

provide the user with an opportunity to select 
the help icon using the remote controller. 

29 . (Canceled) 
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30. (Previously presented) The system defined in 
claim 27 wherein: 

the remote controller comprises a help key; and 
the electronic television program guide is 
further configured to provide the help information to the video 
display generator in response to the user depressing the help 
key on the remote controller. 

31. (Previously presented) The system defined in 
claim 2 7 wherein: 

the help information comprises a text message 
that explains to the user how a portion of the electronic 
television program guide operates; and 

the electronic television program guide is 
further programmed to provide the text message to the video 
display generator for display. 

32. (Previously presented) The system defined in 

claim 27 wherein: 

the help information comprises an instructional 
video that explains to the user how a portion of the electronic 
television program guide operates; and 
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the electronic television program guide is 
further configured to provide the instructional video to the 
video display generator for display. 



33. (Previously presented) The system defined in 

claim 27 wherein: 

the system further comprises a television; 

the help information comprises an instructional 
audio program that explains to the user how a portion of the 
electronic television program guide operates; and 

the electronic television program guide is 
configured to provide the audio program to the video display 
generator for playback by the television. 

34-38 . (Canceled) 

39. (Previously presented) The system defined in 
claim 27 wherein the electronic television program guide is 
further programmed to: 

store the help information in a memory; and 
retrieve the help information from the memory in 
response to receiving the user input. 
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40. (Previously presented) Machine -readable media 
for use with an electronic television program guide, the 
machine -readable media comprising program logic recorded thereon 
for: 

tracking and storing a current operating mode of 
the electronic program guide as the user operates the electronic 
television program guide, wherein the electronic television 
program guide has a plurality of operating modes; 

receiving a user input; and 

providing help information that explains to the 
user how the electronic television program guide operates in 
response to receiving the user input, wherein the help 
information provided is based on the stored current operating 
mode . 

41. (Previously presented) The machine -readable 
media defined in claim 40 further comprising program logic 
recorded thereon for displaying a help icon using the electronic 
television program guide wherein receiving the user input 
comprises receiving a user selection of the help icon. 

42. (Previously presented) The machine -readable 
media defined in claim 40 wherein the program logic for 
providing help information comprises program logic for 
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displaying the help information in response to the user input, 
wherein a user depressing a help key on a remote control 
generates the user input. 

43. (Previously presented) The machine -readable 
media defined in claim 40 wherein the program logic for 
providing help information comprises program logic for. 
displaying a text message that explains to the user how a 
portion of the electronic television program guide operates. 

44. (Previously presented) The machine -readable 
media defined in claim 40 wherein the program logic for 
providing help information comprises program logic for 
displaying an instructional video that explains to the user how 
a portion of the electronic television program guide operates. 

45. (Previously presented) The machine -readable 
media defined in claim 40 wherein the program logic for 
providing help information comprises program logic for playing 
an instructional audio program that explains to the user how a 
portion of the electronic television program guide operates. 

46 . (Canceled) 
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47. (Previously presented) The machine -readable 
media defined in claim 40 further comprising program logic 
recorded thereon for: 

storing the help information in a memory; and 
retrieving the help information from the memory 
in response to receiving the user input. 

48-51. (Canceled) . 

52. (Previously presented) The method defined in 
claim 1 wherein the current operating mode is one of flip, 
browse, menu, impulse ordering, and setting a lockout. 

53. (Previously presented) The system defined in 
claim 14 wherein the current operating mode is one of flip, 
browse, menu, impulse ordering, and setting a lockout. 

54. (Previously presented) The system defined in 
claim 27 wherein the current operating mode is one of flip, 
browse, menu, impulse ordering, and setting a lockout. 

55. (Previously presented) The machine -readable 
media defined in claim 40 wherein the current operating mode is 
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one of flip, browse, menu, impulse ordering, and setting a 
lockout . 

56. (Previously presented) The method defined in 
claim 1 wherein the stored current operating mode of the 
electronic television program guide comprises data reflecting 
the current operating mode. 

57. (Previously presented) The system 
claim 14 wherein the stored current operating mode 
electronic television program guide comprises data 
the current operating mode. 

58. (Previously presented) The system defined in 
claim 2 7 wherein the stored current operating mode of the 
electronic television program guide comprises data reflecting 
the current operating mode. 

59. (Previously presented) The machine -readable 
media defined in claim 40 wherein the stored- current operating 
mode of the electronic television program guide comprises data 
reflecting the current operating mode. 



defined in 
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reflecting 
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the user how the electronic television program guide operates, displaying the help 
information at the bottom of the screen of Television Receiver (TV) 1 26 or 200. Young 
fails to explicitly teach tracking and storing a current operating mode of the electronic 
program guide as the user operates the electronic television program guide and 
providing help information based on the stored current operating mode, however this 
deficiency In Young is disclosed in Richard's reference, which teaches a menu system 
which provides help information, that appear through pop-up windows, at various 
operating mode of the menu, where a user navigates through menus and 
Microprocessor 10, tracks and stores the current operating mode of the menu as the 
user operates the menu and provides help Information based on the stored current 
operating mode of the menu (see col.1, line 6l-col.2, line 61. col.3, line 1-col.4, line 33 
and figs. 1-4, col.5, lines 8-25, line 46-col.6, line 9, ool.7, lines 7-47 and line 47-col.8, 
line 1+). Furthermore figures 5-8, illustrates a display menu where a user via an input 
device interacts with the displayed menu or listing and upon request receives help 
information at the specific location or current state of the point in the menu, concurrently 
with the information related to the task(s). 

With respect to Applicant arguments as to obviousness, Examiner, maintains 
that, the test for obviousness is not whether the features of a secondary reference may 
be bodily incorporate into the structure of the primary reference; nor is it that the 
claimed invention must be expressly suggested in any one or all the references. Rather, 
the test is what the combined teachings of the references would have suggested to 
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those of ordinary skill in the art In this case Young teaches where a user via Remote , 
Control Transmitters (RC) 1 16 or 1 18, selects a key PG 224 "help information key" to 
receive help information for the television program guide 'EPG' or television Menu, that 
explains to the user how the electronic television program guide operates, displaying 
the help information at the bottom of the screen of Television Receiver (TV) 126 or 200. 
Young silent to explicitly teach tracking and storing a current operating mode of the 
electronic program guide as the user operates the electronic television program guide 
and providing help information based on the stored current operating mode, however in 
the same field of endeavor, i.e., a display System for processing and displaying 
electronic menu, listing, guide, etc., this deficiency in Young Is disclosed in Richard's 
reference, which teaches a menu system which provides help information, that appear 
through pop-up windows, at various operating mode of the menu, where a user 
navigates through menus, where a Microprocessor 10, tracks and stores the current 
operating mode of the menu as the user operates the menu and provides help 
information based on the stored current operating mode of the menu, as such 
combining the teaching of Young and Richards would be within the knowledge of one ol 
ordinary skill in the art, and appropriate motivation was given as discussed below in the 
office action. 

Furthermore it appears Applicant's arguments are directed against the 
references individually, one cannot show nonobviousness by attacking references 
individually where the rejections are based on combinations of references. See In re 
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the test is what the combined teachings of the references would have suggested to , 
those of ordinary skill in the art. In this case 

Young teaches where a user via Remote Control Transmitters (RC) 1 16 or 1 1 8, 
selects a key PG 224 rt help information key" to receive help information for the television 
program guide *EPG' or television Menu, that explains to the user how the electronic 
television program guide operates, displaying the help information at the bottom of the 
screen of Television Receiver (TV) 126 or 200. Young silent to explicitly teach tracking 
and storing a current operating mode of the electronic program guide as the user 
operates the electronic television program guide and providing help information based 
on the stored current operating mode, however in the same field of endeavor, i.e., a 
display System for processing and displaying electronic menu, listing, guide, etc., this 
deficiency in Young is disclosed in Richard's reference, which teaches a menu system 
which provides help information, that appear through pop-up windows, at various 
operating mode of the menu, where a user navigates through menus, where a 
Microprocessor 10, tracks and stores the current operating mode of the menu as the 
user operates the menu and provides help information based on the stored current 
operating mode of the menu, as such combining the teaching of Young and Richards 
would be within the knowledge of one of ordinary skill in the art, and appropriate 
motivation was given as discussed below in the office action. 

Furthermore it appears Applicant's arguments are directed against the 
re f erences individually, one cannot show nonobviousness by attacking references 
individually where the rejections are based on combinations of references. See In re 
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Keller, 642 F.2d 413, 208 USPQ 871 (CCPA 1981); In re Merck & Co., 800 F.2d 1091, 
231 USPQ 375 (Fed. Cir. 1986). 

In view of the above* the combination of Young and Richards is proper and 
maintained as repeated below. This Office Action is made FINAL. 

Claim Rejections -35 USC §103 

2. The following Is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention Is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject tnatter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner In which the invention was made. 

3. Claims 1, 4, 5, 13, 14. 17, 18, 26, 27, 30, 31, 39, 40, 42, 43, 46 and 47 
and 52-59 are rejected under 35 U.S.G. 103(a) as being unpatentable over Young et al 
(4,706,121) in view of Richards et al (5,179,654). 

As to claim 1 , note the Young reference figures 1-3, discloses a TV schedule or 
EPG system and process which allows a user selection of broadcast programs from 
schedule information and further discloses a method for providing help information that 
explains to a user of an electronic television program guide how the electronic television 
program guide operates, the method comprises the following: 

the claimed "receiving a user Input and providing help information that explains to 
the user how the electronic television program guide operates..." is met by Remote 
Receiver (RR) 118 or 190 (figs. 3-5, col. 7, lines 33-57 and col. 9, line 48-col. 10, line 
10), note that RR 118 or 190 receives via Remote Control Transmitters (RC) 1 16 or 
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118, user inputs where if the user selects key PG 224 "help information key" on RC 116 , 
or 118, help information (col. 9, line 54 arid col. 12, lines 30-44) that explains to the user 
how the electronic television program guide (EPG) operates is displayed at the bottom 
of the screen of Television Receiver (TV) 1 26 of 200. 

Young fails to explicitly teach tracking and storing a current operating mode of the 
electronic program guide as the user operates the electronic program guide and 
providing help information based on the stored current operating mode. 

However, Richards teaches a menu system which provides help information, that 
appear through pop-up windows, at various operating mode of the menu and the 
system tracks and stores the current operating mode of the menu as the user operates 
the menu and provides help Information based on the stored current operating mode of 
the menu and where the stored current operating mode of the menu comprises data 
reflecting the current operating mode (figs. 1-4, col.1, line 61-col.2, line 61, col.3; line 1- 
col.4, line 33, col.5, HneS 8-25, line 46-col.6, line 9, col.7, lines 7-47 and tine 47-C6I.8, 
line 1+), note that the user navigates through menus and Microprocessor 10, tracks and 
stores each menu and also items within each menu to dynamically provide different 
levels of help information based on the mode of operation of a menu. 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to incorporate the teaching of Richards into the system of Young to 
dynamically generate help text or instruction and display help text on each selected tile, 
item or grid of the EPG data, and furthermore enable interaction with each selected tiles 
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or grid of the EPG data for additional information, help or instructions relating to the 
selected tile or grid of the EPG data. 

As to claim 4, Young further discloses where RC 116 or 1 18 generates the user 
input in response to the user depressing PG 224 "help information key" on RC 116 or 
1 1 8 (col. 9, line 54 and col. 1 2, lines 30-44), to displayed help information at the bottom 
of the screen of TV 1 26 or 200. 

As to claim 5, Young further discloses displaying a text message (col. 12, lines 
30-58), which explains to the user how a portion of the EPG operates. 

As to claim 1 3, Young further discloses storing the help information in memory 
and retrieving the help information from the memory in response to receiving the user 
input (col. 7, lines 47-64, col. 8, lines 32-44 and col. 1 2, lines 64-68). 

As to claim 14, note the Young reference figures 1-3, discloses a TV schedule 
system and process which allows a user selection of broadcast programs from schedule 
information arid further discloses a method for providing help information that explains 
to a user of an electronic television program guide how the electronic television program 
guide operates, the system comprises the following: 

the claimed "means for receiving a user input and means for providing help 
information that explains to the user how the electronic television program guide 
operates..." is met by Remote Receiver (RR) 118 or 190 (figs. 3-5, col. 7, lines 33-57 
and col. 9, line 48-cot. 10, line 10), note that RR 1 18 or 190 receives via Remote 
Control Transmitters (RC) 116 or 118, user inputs, where If the user selects key PG 224 
"help information key" on RC 116 or 118, help information (col. 9, line 54 and col. 12, 
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lines 30-44), that explains to the user how the electronic television program guide 
operates is displayed at the bottom of the screen of Television Receiver (TV) 126 or 
200. 

Young fails to explicitly teach tracking and storing a current operating mode of 
the electronic program guide as the user operates the electronic program guide and 
providing help information based on the stored current operating mode. 

However, Richards teaches a menu system which provides help information, that 
appear through pop-up windows, at various operating mode of the menu and the 
system tracks and stores the current operating mode of the menu as the user operates 
the menu and provides help information based on the stored current operating mode of 
the menu and where the stored current operating mode of the menu comprises data 
reflecting the current operating mode (figs. 1-4, col.1, line 61-col.2, line 61, col.3, line 1- 
col.4, line 33, col.5, lines 8-25, line 46-col.6, line 9, col.7, lines 7-47 and line 47-col.8. 
line 1 +), note that the user navigates through menus and Microprocessor 10, tracks and 
stores each menu and also items within each menu to dynamically provide different 
levels of help information based on the mode of operation of a menu. 

Therefore It would have been obvious to one of ordinary skill in the art at the time 
of the invention to incorporate the teaching of Richards into the system of Young to 
dynamically generate help text or instruction and display help text on each selected tile, 
item or grid of the EPG data, and furthermore enable interaction with each selected tiles 
or grid of the EPG data for additional information, help or instructions relating to the 
selected tile or grid of the EPG data. 
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Claim 17, Is met as previously discussed with respect claim 4. 

Claim 1 8, is met as previously discussed with respect claim 5. 

Claim 26, is met as previously discussed with respect Claim 13. 

As to claim 27, note the Young reference figures 1-3, discloses a TV schedule 
system and process which allows a user selection of broadcast programs from schedule 
information and further discloses an electronic television program guide system that 
provides help information for explaining to a user of an electronic television program 
guide how the electronic television program guide operates, the system comprises the 
following; 

the claimed "a video display generator," is met by Video Display Generator 
(VDG) 204 (col. 8, lines 48-62); 

the claimed "a remote controller," is met by Remote Control Transmitters (RC) 
1 16 or 1 18 (col. 7, lines 33-57 and col. 9, lines 48-52); 

the claimed "a microcontroller," is met by CPU 1 78 (col. 8, lines 35-62); and 
electronic television program guide (EPG) executed by CPU 1 78 and programmed to 
receiver a user input via Remote Control Transmitters (RC) 116 or 118 and Remote 
Receiver (RR) 1 18 or 190 (figs. 3-5. col. 7, lines 33-57 and col. 9, line 48-col. 10, line 
10), and provides help information at the bottom of the screen of Television Receiver 
(TV) 126 or 200 that explains to the user how the EPG operates to the VDG 204 in 
response to receiving the user input, i.e., when the user presses PG 224 "help 
information key" on RC 166 or 118. 
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Young fails to explicitly teach tracking and storing a current operating mode of , 
the electronic program guide as the user operates the electronic program guide and 
providing help information based on the stored current operating mode. 

However, Richards teaches a menu system which provides help information, that 
appear through pop-up windows, at various operating mode of the menu and the 
system tracks and stores the current operating mode of the menu as the user operates 
the menu and provides help information based on the stored current operating mode of 
the menu and where the stored current operating mode of the menu comprises data 
reflecting the current operating mode (figs. 1-4,cpl.1, line 61-col.2, line 61, col.3, line 1- 
col.4, line 33, col.5, lines 8-25, line 46-col.6, line 9, col.7, lirtes 7-47 and line 47-coL8, 
line 1+), note that the user navigates through menus and Microprocessor 10, tracks and 
stores each menu and also items within each menu to dynamically provide different 
levels Of help information based on the mode of operation of a menu. 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to incorporate the teaching of Richards into the system of Young to 
dynamically generate help text or instruction and display help text on each selected tile, 
item or grid of the EPG data, and furthermore enable interaction with each selected tiles 
or grid of the EPG data for additional information, help or instructions relating to the 
selected tile or grid of the EPG data. 

Claim 30, is met as previously discussed with respect claim 4. 

Claim 31, is met as previously discussed with respect claim 5. 

Claim 39, is met as previously discussed with respect claim 13. 
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As to claim 40, note the Young reference figures 1-3, discloses a TV schedule , 
system and process which allows a user selection of broadcast programs from schedule 
information and further discloses machine-readable media for use with ah electronic 
television program guide, the machine-readable media comprising program logic 
recorded there for the following: 

the claimed "receiving a user input and providing help information that explains to 
the user how the electronic television program guide operates..." is met by Remote 
Receiver (RR) 118 or 190 (figs. 3-5, col. 7, lines 33-57 and col. 9, line 48-col. 10, line 
1 0), note that RR 1 1 8 or 1 90 receives via Remote Control Transmitters (RC) 1 1 6 or 
118, user inputs where if the user selects key PG 224 "help information key" on RC 1 16 
or 118, help information (col. 9, line 54 and col. 12, lines 30-44) that explains to the user 
how the electronic television program guide operates is displayed at the bottom of the 
screen of Television Receiver (TV) 126 or 200. 

Young fails to explicitly teach tracking and storing a current operating mode of 
the electronic program guide as the user operates the electronic program guide and 
providing help information based on the stored current operating mode. 

However, Richards teaches a menu system which provides help information, that 
appear through pop-up windows, at various operating mode of the menu and the 
system tracks and stores the current operating mode of the menu as the user operates 
the menu and provides help information based on the stored current operating mode of 
the menu and where the stored current operating mode of the menu comprises data 
reflecting the current operating mode (figs. 1-4, col.1, line 61-col.2, line 61. col.3. line 1- 
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cpl.4, line 33, col.5, Ones 8-25, line 46-col.6, line 9, col.7, lines 7-47 and line 47-cpl.8, , 
line 1+), note that the user navigates through menus and Microprocessor 10, tracks and 
stores each menu and also items within each menu to dynamically provide different 
levels of help information based on the mode of operation of a menu. 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to incorporate the teaching of Richards into the system of Young to 
dynamically generate help text or instruction and display help text on each selected tile, 
item or grid of the EPG data, and furthermore enable interaction with each selected tiles 
or grid of the EPG data for additional Information, help or instructions relating to the 
selected tile or grid of the EPG data. 

Claim 42, is met as previously discussed with respect claim 4. 
Claim 43, is met as previously discussed with respect claim 5. 
Claim 47, is met as previously discussed with respect claim 13. 
Claim 52. is met as previously discussed with respect claim 1 , note the current 
operating mode is a menu as disclosed in Richards. 

Claim 53, is met as previously discussed with respect claim 14, 
Claim 54, is met as previously discussed with respect claim 27, 
Claim 55, is met as previously discussed with respect claim 40. 
Claim 56, is met as previously discussed with respect claim 1 , 
Claim 57, is met as previously discussed with respect claim 14, 
Claim 58, is met as previously discussed with respect claim 27. 
Claim 59, is met as previously discussed with respect claim 40. 
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4. Claims 2, 6, 7, 15, 19, 20, 28, 32, 33, 41, 44 and 45, are rejected under 35 
U.S.C. 103(a) as being unpatentable over Young (4,706,121) in view of Richards et al 
(5,179,654) as applied to claims 1 , 14, 27 and 40 above, and further in view of Palmer 
etal (6,320,588). 

As to claims 2, 15, 28 and 41 , Young as modified by Richards displays a help 
menu at the bottom of the screen upon receiving a user selection, but fail to explicitly 
teach displaying a help icon. 

However, Palmer teaches displaying a help icon on a menu (fig. 23 and col. 19, 

lines 31-39). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to incorporate the teaching of Palmer into the system of Young as 
modified by Richards to piovkie a help icon as a visual mnemonics on the screen for a 
user-friendly GUI that allows the user to control without having to remember a command 
or input at a remote control or keyboard. 

As to claims 6, 7, 19. 20, 32, 33, 44 and 45, Young as modified by Richards fails 
to explicitly teach where the help information comprises displaying an Instructional video 
or audio that explains to the user how a portion of the EPG operates. 

However, Palmer further teaches a menu system, with audio/visual help 
instruction, which explains how a portion of the menu operates (figs. 23-25, col. 17, line 
64-col. 18, line 2, col. 19, lines 31-39 and col. 22, line 63-col. 23, line 1+), note that the 
help instruction offers the user three levels comprehensive textual, audio and visual 
system documentation (col. 23* lines 30-39). 
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6. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Annan Q. Shang whose telephone number is 571- 

272- 7355. The examiner can normally be reached on 700am-400pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiners 
supervisor, Christopher S. Kelley can be reached on 571-272*7331. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 

273- 8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status Information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from 
a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 




Annan Q. Shang 
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[57] ABSTRACT 
A system (90) controls a television receiver (126) to 
allow user selection of broadcast programs from sched- 
ule information. A data processor (110) is connected to 
receive the schedule information from an FM receiver 
(94), decoder (98) and data demodulator (102). A user 
remote control transmitter 116-remote receiver (118) 
combination supplies user selection inputs to the data 
processor (110). The data processor (110) selects pro- 
grams from the schedule information based on the user 
inputs, The schedule information for the selected pro- 
grams is stored in a memory (111), and is used by the 
data processor (110!) to control a programmable TV 
tuner (132) to provide the broadcast signals for the 
selected programs to the TV receiver (126) at the time 
of broadcast The system (90) can also be used to con- 
trol a VCR (150) for unattended recording of the se- 
lected programs. 

56 Claims, 14 Drawing Figures 
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1 2 

conflicting time schedules, with two or more programs 
TV SCHEDULE SYSTEM AND PROCESS overlapping each other. Conventionally published pro- 

gram listings are not capable of handling last minute 
ORIGIN OF THE APPLICATION schedule changes and additions. For these and other 

Thisapplicationisacontinuation.b.partofmy 5 T^l!^*!?^^ 

cation Ser No. 754,630, filed July 12, 1985, now aban- select and view, or perform unattended recording of 

^ onec j programs of interest in an easier and more dependable 

fashion. 

BACKGROUND OF THE INVENTION Significant problems are encountered by users of 

1. Field of the Invention 10 VCRs as presently operated. Programming a VCR for 
This invention relates to an electronic system and a unattended operation requires considerable skill and 

process for controlling a television set to present pro- care. It is necessary to select the station, the day of the 

grams selected in advance from a schedule by a user. week, the time, including a.m. or p.m., and the length of 

More particularly, it relates to such an electronic system the program for each program to be recorded. The 

and process which allows the user to make the broad- 15 process is even more complex if the user wishes to set 

cast program selection using selection criteria that can the VCR for automatic recording of a program in the 

be combined in different ways. Most especially, the future at a given time while watching another program 

invention relates to such an electronic system and pro- at the same time, Mary VCR owners are unable to 

cess which receives the schedule information in broad- master the complexities of setting the VCR for unat- 

cast form and then processes the schedule information 20 tended operation, and simply do not use that feature of 

to make the selections. The invention further relates to the equipment Almost all users, at one time or another, 

a system that will enable a user to program a video have recorded the wrong program through an inadver- 

cassette recorder (VCR) for unattended operation by tent incorrect setting of the VCR. 
making a simple selection from a menu. While a variety of systems incorporating VCRs and 

2. Description of the Prior Art 25 y CR control systems are known in the art, none deal 
A variety of electronic systems which can be con- ^ ^ comp lexity of setting a VCR for unattended 

nected to a conventional television receiver to increase recording. U.S. Pat No. 4,523,295, issued June 11, 1985 

the functionality of the receiver are known in the art to ^to discloses a VCR control system including a 

For example, systems that will allow a user to select nonvo latile memory for storing user programmed sys- 

teletext messages broadcast as auxiliary ^formation in 3D ^ information in the event of a power outage, 

otherwise unused portions of conventional television Qther ^ mcluding V CRs are disclosed in the 

broadcasts are ' dteJued in 1UA Pat No. <M86,4U, followin u#s , Pat Nos . : 4,272,791, issued June 

TSSfJP !i « ? « lo^f^L^ JS" 9, 1981 to Rifken and U.S. Pat. No. 4,530,048, issued 

4,288,809, issued Sept 8, 1981 to Yabe, and U.S. Pat • „ ig& - ~ 

No. 4,36 1 Mb issued Nov. 30 1982 to Poi^et et al A 35 W a ^ ^ of ^ 

variety of other electronic systems for controlling tele- J"^g? available. Since arable channel will 

vision sets or other related apphcations are postal m ^™Ignal on different numbered channels in 

&&S^^ 

42*5 967 issued Sept 30, 1980 to Miwa et al.; U.S. Pat 40 unused, P ro S^~S^ r .^ 
No 4,290,062, issued Sept 15, 1981 to Marti et al.; U.S. Gemmated on ™™ 
Pat No. 4,430,669, issued Feb. 7, 1984 to Cheung; and of the charael, rather than the .^ c ^^5^ m : 
U.S. Pat No. 4,506,387, issued Mar. 19, 1985 to Walter. *f on wWch the sigiid is M PP h ^^ 

As the number of television stations in a metropolitan set must be tuned by the channel number In the San 
area or on a cable network has increased, a larger num- 45 Franctsco metropohton ^^^%J^^ 
ber of programs of potential interest to a viewer is pres- Presently 15 different cable channels that are bsted by 
ented. With the use of dish antennas capable of receiv- name, not channel number A view ^ K ^, 0 ^ a n ? A t 
ing direct satellite signals, the multitude of programs remember the channel number on which a given cable 
available to the viewer is further increased. At the ores- service is furnished^ espe^ly * that service is only 
ent time, the user must consult a published program 50 watched occasionally. U.S. Pat No. 4,405,946, issued 
guide, such as TV Guide Magazine or program listings Sept 20, 1983 to Knight, discloses a system for provid- 
published in newspapers, in order to select programs for ing an on-screen display of channel numbers or an indi- 
viewing. Particularly if the viewer is interested in a cation that a signal is coming from a recording device, 
special category of program broadcast at irregular in- but with no teaching or suggestion of displaying a cable 
tervals, such as tennis tournaments, being aware of 55 channel by name rather than number, 
programs of special interest and selecting them for When satellite broadcasts are considered, the situa- 
viewing is often difficult Should the viewer find a pro- tion becomes even more complex. Satellite TV guides 
gram of interest which is broadcast at a time when the list all programs of satellites broadcast in the U.S. by the 
viewer will be unable to view the program, the user hour. Fifty or more programs may be listed under each 
must then set a VCR or other recording device to re- 60 hour or half hour heading. Depending on such factors 
cord the program for viewing at a more convenient as geographic location and equipment capability, many 
time. Often, a viewer will notice a program of special users will only be able to receive a small, fraction of the 
interest in the program listing, but forget to select the listed programs. It would be desirable for a user to be 
appropriate channel for viewing at the time of broad- able to reduce the number of such listings to be con- 
cast or set the VCR to record the program, or the 65 suited in making a program selection. It would also be 
length of the program for proper operation of the VCR desirable for the viewer to be able to eliminate listings 
to record the program. If there is more than one pro- for encrypted programs for which the user is not a 
gram to be recorded, it is easy to select programs with subscriber. 
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qttmvi a p v np tub TNVPNnnM 11 " a sti!1 filrther of invention to provide 

SUMMARY OF THE INVENTION such a system and process in which the user is notified 

Accordingly, it is an object of this invention to pro- of conflicting time schedules for programs selected for 

vide a system and process which allows a user to con- viewing and/or recording. 

trol a television set by selecting broadcast programs for 5 It is another object of the invention to provide such a 
viewing from schedule information with user-supplied system and process in which a user identification system 

selection criteria. is employed to ensure pay subscription to the TV sched- 

It is another object of the invention to provide such a ule system, 

system and process which receives the schedule infor- It is still another object of the invention to provide 

mation as a broadcast 10 such a system and process in which special program 

It is another object of the invention to provide such a linking and theme information is broadcast in order to 

system and process which is capable of accommodating allow easier program selection by the user, 

last minute schedule changes and additions. It is a further object of the invention to provide such 

It is a further object of the invention to provide such a system and process in which actual names of channel 

a system in which the user supplied selection criteria 15 services, such as HBO, ESPN and the like, are dis- 

can be combined by the system to make program selec- played to the viewer and by which the viewer may 

tion. select the channel service, in place of channel numbers 

It is a still further object of the invention to provide on which such services are supplied, 

such a system and process in which the selection criteria It is still another object of the invention to provide 

can be either criteria of inclusion or exclusion. 20 such a system and process in which unique schedule 

It is another object of the invention to provide such a data, such as linking, theme, satellite and channel name, 

system and process in which the need to make manual satellite encryption, scrambled transmission, is supplied 

channel selection is eliminated and all programs are as a basis for the user to select listings for viewing and- 

selected by pointing to menu items. /or recording. 

It is still another object of the invention to provide 25 It is a still further object of the invention to provide 

such a system and process which will determine if the such a system and process in which the length of time 

television set is turned on at the time of the selected since a program being broadcast has started and how 

broadcast program and automatically supply the se- much time remains for the program is displayed, to the 

lected program to a VCR or other program recording user when the user turns on the program, 

device if the television set is not turned on. 30 The attainment of these and related objects may be 

Independently of the television set, it is another ob- achieved through use of the novel electronic system and 

ject of the invention to provide greatly simplified and process for controlling a television receiver to allow 

reliable unattended recording of television programs. user selection of broadcast programs herein disclosed. 

It is a still further object of the invention to provide As used herein, the term * "broadcast" refers not only to 

such a system and process which is capable of selecting 35 transmission by airwaves, but also to other forms of 

a single program in a multiple program series and auto- transmission, such as by cable. A system for controlling 

matically including the rest of the programs in the se- a television receiver to allow user selection of broadcast 

ries. programs from schedule information in accordance 

It is another object of the invention to provide such a with the invention includes a data processor. A first 

. system and process which will automatically terminate 40 input means for the schedule information is connected 

selection of a series of programs when the last program to the data processor. A second user selection input 

of the series has been completed. means is also connected to the data processor. The data 

It is yet another object of the invention to provide processor is configured to select programs from the 
such a system and process which will automatically schedule information based on user inputs. A storage 
perform unattended recording of a program of uncer- 45 means is connected to receive the schedule information 
tain length, such as a sporting event, and terminate the for programs selected by the data processor. A pro- 
recording as soon as the program of uncertain length grammable tuner is provided for connection to the tele- 
has been completed. vision receiver. The programmable tuner is connected 

It is a further object of the invention to provide such to receive control signals from the data processor for 
a system and process which will allow certain programs 50. causing the programmable tuner to supply broadcast 
and/or channels to be excluded from the selection un- signals for the selected programs to the television re- 
less the user enters a coded password. ceiver at the time of the selected program broadcasts. 

It is still another object of the invention to provide The process of this invention includes the following 

such a system and process in which such user selections steps. Program schedule information is supplied to a 

are used for unattended, automatic operation of a VCR 55 data processor. User program selection criteria are sup- 

or other recording device. plied to the data processor. The user selection criteria 

It is a still further object of the invention to provide are used to select programs for viewing from the pro- 
such a system and process controlling a VCR in which gram schedule information in the data processor. The 
the user selections are used for automatic, preselected stored information is used to tune the television receiver 
recording of one program on a VCR while the user is 60 to the selected programs. 

viewing another program on a television set In a preferred form of a system and process in accor* 

It is yet another object of the invention to provide dance with the invention, the schedule information is 

such a system and process in which all parameters of a also broadcast, either during an otherwise unused por- 

program for viewing and/or recording can be set with tion of a conventional television broadcast, such as 

a single user selection. 65 during a horizontal or vertical flyback interval, or as a 

It is a further object of the invention to provide such separate broadcast, such as a frequency modulation 

a system and process in which the user is not required to (FM) broadcast The preferred system includes a video 

leave the VCR powered on for unattended recording. display generator connected to receive signals from the 
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data processor for generating a video display from the FIG. 3 is a block diagram of a system in accordance 

schedule information and the user selections on the with the invention for use with the transmitter of FIG. 

television receiver. The video display generator is con- 1. 

nected to supply video display signals to a video FIG. 4 is a block diagram of another system in accor- 

switcher. The programmable tuner is also connected to 5 dance with the invention for use with the transmitter of 

supply the broadcast program signals to the video FIG. 2. 

switcher. The data processor is configured and con* FIG* 4B is a block diagram of a modified form of the 

nected to control the video switcher to supply the system in FIG. 4, which also is used with the transmitter 

broadcast program signals and/or the video display of FIG. 2. 

signals as required in operation of the system to the 10 FIG. 5 is a plan view of a control panel used in the 

television receiver. In its preferred form, the data pro- systems of FIGS. 3-4. 

cesser of the system is further configured to provide FIGS. 6-13 are flow charts of software used with the 

signals to the video display generator for presenting a systems shown in FIGS. 3-4. 

plurality of user selection menus on the television re- nPTATT Fn r>F ^pu tpttdn of the 

ceiver. The second user selection input means includes 15 DETAILED ^DKCMPTION OF THE 

a plurality of keys for making selections from the menus i« v bn i iujn 

for use in choosing programs from the scheduled infor- l. General System and Process Description 

mation. Turning now to the drawings, more particularly to 
Once the system has beenjasedby a v*wer to make is shown a frequency modulation (FM) 
program selections on the basis of the viewer selected 20 u ^ tta ^ for 8U pp lym gTV schedule information 
criteria, the system operation can be purely automatic, asmPM broadcast. TnL form of a transmitter allows 
so that programs of special interest are not missed necessary 8chedule information to be broadcast 
through forgetfulnes* fadependeX of the television broadcasts themselves, 
through a volume of schedule infomadcmto find pro- ^ j^n^ avaM ,, e to 
grams meeting the viewer' selection criteria, the pro- 25 * broadcasts, this form of trans- 
gram selection is much eas.ei -nd more. »pdwj Ae ^ cooperation of the televi- 
system of this invention than withmanual ■dwboa. By ^ transmitter 20 includes a 
wav of example, the system can be used to select satel- . »« • « f . , . 

SimUariy, for viewers without special decryption ser- microcomputer such as an IBM ? P^^ 0 ^f^ 

vice, the system wiU remove from display those satellite «»PI*« 22? 

listtogs which are of no value to the viewer because 35 ««P* signals to the date modulate 26. TCe data modu- 

they tre encrypted lator 26 ^exls the digital outputs of the mjcrocom- 

In another aTpeci of the invention, the system can be puter 22 to a form ^ wluch they can ^ed to generate 
automatically linked to a VCR, so that menu selection FM signals, ^ output of data m^*ator26 * suppl ed 
of programs to record replaces the often confusing to an FM modulator 30 on line 3Z The ,FM modulator 
techniques required to the unattended operation fea- 40 30 generates a set of fteqincy modukted signals corre- 
. tures of the VCR. By selecting a desired program for spondmg to the data, which are supphed to an SCA 
. recording from a menu display, the chance for error is subcarner generator 34 on line 36. The generator 34 
practically eliminated. The viewer can verify the pro- produces the SCA subcarner and applies the frequency 
grams to be recorded by a display of the names of the modulated signals to the SCA subcarner. The output ot 
programs. In the event of a schedule change at the 45 generator 34 is supplied to an FM exciter 38 on line 40. 
station, the system will automatically update the sched- The exciter 38 generates the required FM broadcast 
ule change and revise the time of the unattended record- signals, which are supplied to an RP power amplifier 42 
ing. In one form of this aspect of the invention, the on line 44. The power amplifier amplifies the FM broad- 
system is connected to the remote control facilities of a cast signals and supplies them to transmrttmg antenna 46 
VCR to turn on its power, start the recording, and stop 50 on line 48. The data modulator 26, FM modulator 30, 
recording of programs on the VCR. The user is there- SCA subcarrier generator 34, FM exciter 38 and RF 
fore not required to leave the VCR powered on for power amplifier 42 are all implemented with commer- 
unattended recording. In this manner, a conventional cially available system components conventionally em- 
remote control VCR is connected in the system without ployed for broadcast of data processing information 
modification for unattended recording of scheduled 55 signals. Since the design and implementation of the 
programs. system 20 is itself conventional, and the novelty resides 

The attainment of the foregoing and related objects, in the particular data processing information signals 

advantages and features of the invention should be more broadcast with the system 20, the design and operation 

readily apparent to those skilled in the art after review of the system 20 will not be described in further detail, 

of the following more detailed description of the inven- 60 FIG, 2 is a block diagram of a similar system 50 that 

tion, taken together with the drawings, in which: is used to broadcast the television schedule information 

as part of an otherwise conventional television broad- 

BRIEF DESCRIPTION OF THE DRAWINGS cast? ^rig a normally unused portion of the TV frame, 

FIG. 1 is a block diagram of a transmitter for use with such as the horizontal or vertical flyback. The I/O port 

a system and process in accordance with the invention. 65 24 of the microcomputer 22 is connected by line 52 to a 

FIG. 2 is a block diagram of another transmitter for buffer 54, which converts the digital schedule infor- 

use with another embodiment of a system and process in maticn signals supplied by the microcomputer to a form 

accordance with the invention. suitable for FM modulation. The output of buffer 54 is 
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supplied to an FM modulator 56 on line 58. The fre- the program schedule data on line 108, control program 
quency modulated schedule information signals are inputs on line 114 and user inputs on line 120 to a video 
provided by the modulator 56 for incorporation in the display generator 136 on line 138* Output video display 
unused portion of the television broadcast in a transmit- signals from the generator 136 are supplied to a video 
ter video input unit 60 on line 62. Signals for a TV 5 switcher 140 on line 142, The video switcher also re- 
program to be broadcast are also supplied to the video ceives TV program signals from tuner 132 on line 144, 
input unit 60 on line 64 and to an insertion controller 66 and a control signal for switching between the tuner 132 
on line 68 by program source 69, consisting of TV guide and the generator 136 on line 146 from the CPU 110. 
data as well as identification codes, in the case of pay The video switcher 140 supplies the signals from the 
subscriber service. The identification code is a unique 6 10 tuner 132 or the generator 142 to the TV receiver 126 
or 7 digit code for every subscriber. By deleting the on line 148 and to a video cassette recorder (VCR) 150 
identification code, an unpaid subscriber is prevented on line 152. The CPU 110 is connected to the VCR 150 
from receiving the TV guide data. The insertion con- by line 154, for turning on the VCR. For most VCRs, 
trailer 66 utilizes the program signals to generate syn- the line 154 should be connected to the pause input of 
chronizing signals for the unused portions of the TV IS the VCR. The CPU is connected to an alarm 156 by line 
frame, which are supplied to the buffer 54 and the mod- 158 for indicating to a user a short time (e.g., five min- 
ulator 56 on lines 72 and 74, respectively. The combined utes) before a selected program is to be broadcast that 
program and schedule information broadcast signals are the TV receiver 126 should be turned on if it is off, so 
supplied by the transmitter video input unit 60 to a that the selected program can be viewed. The operation 
power amplifier 76 and an RF multiplexer 78 on lines 80 20 of the receiver system 90 will be explained further in the 
and 82, respectively. The amplified broadcast signals explanation of the construction and operation of the 
are supplied by amplifier 76 to a transmitting antenna 84 controller 116 in connection with Figure 5. 
on line 86. The broadcast signals are supplied by multi- FIG. 4 is a block diagram of another receiver system 
plexer 78 as cable television signals at output 88. As in 160, which may be used with the transmitter system 50 
the case of the system 20, the system 50 is implemented 25 shown in FIG. 2. Antenna 162 receives the TV broad- 
with conventional system components. The system 50 is cast signal from the transmitter system 50 and supplies it 
of a type conventionally employed for the broadcast of to a programmable TV tuner 164 on line 166. The tuner 
teletext signals in unused portions of a television pro- 164 supplies the broadcast signal to a program data 
gram broadcast signal, and the novelty resides in the tinting controller 168 on line 170, to data demodulator 
particular teletext signals broadcast in this manner. The 30 169 on line 171 and to a video switcher 172 on line 174. 
design and operation of the system 50 wfll therefore not The output of controller 168 is supplied to the demodu- 
be explained in further detail. lator 169 on line 176. The demodulator 169 supplies the 

FIG. 3 is a block diagram of a receiver and television program schedule information signals, which have been 
receiver control system 90 which is used in combination stripped from the TV broadcast signals and digitized, to 
with the FM transmitter system 20 of FIG. 1. An FM 35 CPU 178 of system control unit 180 on line 182. A 
antenna 92 receives the broadcast signals from the sys- memory 179 is connected to the CPU 178 at 181 to 
tern 20, which are supplied to FM receiver 94 on line 96. receive selected program information and to supply the 
FM receiver 94 supplies the FM broadcast signals to an selected program information at the appropriate time 
SCA subcarrier decoder 98 on line 100. The decoder 98 for the CPU 178 to generate control signals for the 
strips the schedule information signals from the FM 40 programmable tuner 164. User ID code and control 
broadcast signals and supplies the schedule information program inputs to the CPU are provided by ROM 184 
signals to a data demodulator 102 on line 104. The data on line 186. User program selections and other user 
demodulator 102 converts the schedule information inputs are provided by a i remote control transmitter 
signals to digital form and supplies the digital schedule 188-remote receiver 190 combination on line 192. Other 
data signals to system control unit 106 on line 108, more 45 inputs to the CPU 178 are supplied by system clock 194 
particularly, to CPU 110 of the system control unit 106. oh line 196, and on line 198, connected to the power 
A memory 111 is connected to the CPU 110 at 113. A supply for TV receiver 200, in order to allow CPU 178 
control program for the system control unit 106 and a to determine if the TV receiver 200 is turned on. From 
user identification code are stored in a read only mem- the user inputs on line 192 and the control program, the 
ory (ROM) 112. ROM 112 communicates with the CPU 50 CPU generates control signals for the programmable 
110 on line 114. Other inputs to the CPU 110 are sup- TV tuner 164, which are supplied on line 202, and video 
plied by a remote transmitter controller 116-remote display information signals, which are supplied to video 
receiver 118 combination on line 120, which supplies display generator 204 on line 206. The generator 204 
user selection and other user inputs to the CPU 110, and converts the video display information signals to video 
on line 122, connected to power input 124 of television 55 display signals, which are supplied to the video 
receiver 126, which allows CPU 110 to determine if the switcher 172 on line 208. The CPU 178 supplies control 
receiver 126 is turned on. System clock 128 of the sys- signals for the video switcher 172 on line 210 to switch 
tern control unit 106 is connected to the FM receiver 94 the video signal outputs of the video switcher 172 on 
by line 130. lines 212 and 214 to the TV receiver 200 and VCR 216 

The CPU 110 supplies control outputs, based on user 60 between the schedule information video signals from 
selections, to a programmable TV tuner 132 on line 134. generator 204 and the program video signals from tuner 
Information identifying programs selected from the 164. The CPU 178 provides a control signal for turning 
schedule information on the basis of the user selection - on the VCR on line 218 when a desired television pro- 
criteria is stored in memory 111 by the CPU 110. The gram signal is being received by tuner 164 and CPU 178 
CPU retrieves the information at the appropriate time 65 determines from the input on line 198 that TV receiver 
for generating the control outputs. The tuner receives 200 is not turned on. The CPU 178 is connected to 
conventional TV broadcast signals from antenna 133 on alarm 217 by line 219 for providing an audible signal to 
line 135. The CPU 110 supplies information signals from a user shortly before broadcast of a selected program if 
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the TV receiver 200 is turned off, as a signal to turn it «-238: Moves to previous page; pointer unchanged, 
on. The operation of the cable TV or TV program Wraps to end of week if listing is already at start 
receiver system 1(50 will be described further below in P 240: If not preceded by a numeric key, P will re- 
connection with FIGS. 5-13. strict listing to prime time only. If entered after a 

FIG. 4B is a block diagram of a modified form of the 5 numeric key, P indicates PM. 
receiver 160, which may also be used with the transmit- A 242: If not preceded by a numeric key, A will 
ter system 50 shown in FIG. 2. In the FIG. 4B receiver restrict listing to selected themes only. If after a 
160, a remote VCR 216 and its wireless remote control- numeric key, A will indicate AM, 
ler 1010, so that the remote VCR 216 need not be pow- 244: Advances to the next day, hour unchanged, 
ered up in advance of unattended recording. The re- 10 Wraps around by days of the week, 
mote controller 1010 is connected by lines 1000 and wtr± Mo**~ n^A- vr«^« 
1002 to CPU 178. In response to the CPU 178, the re- MO M ^ ster Gmde Mode 
mote controller 1010 transmits control signals to the This mode allows direct selection of a program from 
remote VCR 216 in a conventional manner, as indicated the listing. For the average user, the Master Guide 
at 1004. The remote controller 1010 can be either a unit 13 (MG) mode is the only mode used. To access the MG 
designed for the VCR, but modified to be electrically mode, press the MG key 222 once: to exit mode, press 
operated from the TV scheduler, or it can be an equiva- the MG key 222 a second time, or use the SEL key 228 
lent design of the remote controller with direct connec- if the pointer is positioned at the desired program, 
ticms to the CPU 178. Instead of enabling the VCR from The keyboard 220 may be used as a conventional TV 
the pause line 214, when the CPU 178 determines that a 20 selector by pressing the digit keys only, when the TV 
program is to be recorded (see, e.g., block 501 of FIG. scheduler 160 is in the manual mode after the TV key is 
13) according to the selected programs, it issues a con- pressed. When used as a manual channel selector, each 
trol signal to power up the VCR on control line 1000. time that a new channel is selected, a channel number 
This control signal generates a contact closure across will appear on the bottom line of the screen. If a service 
the switch matrix of the remote controller 1010 power- name is associated with a signal received on a particular 
on key. The contact closure may be obtained with a channel, the channel name will be displayed, rather than 
relay or an FET transistor switch. The control signal on the channel number. Thus, if channel 3 is HBO, HBO 
line 1000 also generates a contact closure across the will be displayed. Each time a channel is selected, a 
play key and the record key of the controller 1010 to 30 channel number or channel name, the name of the pro- 
initiate recording of the program. When the program gram, how long the program has been on, and how long 
ends, CPU 178 will issue a control signal on line 1002. remains for the program will appear on the bottom lines 
Line 1002 generates a contact closure across the remote of the screen. For example, when the user scans the 
controller power-off key. When the CPU 178 deter- channel, it will show: 

mines another program is to be recorded, the above 35 ' 

process is repeated. ^ HBO Prizzi's Honor on for 55 minutes 

In order to carry out background recording of a end in 35 minutes . 

program while watching another program on the TV 

receiver 200, line 212 is connected to the AUX input of * « ^ . 4 . ... 4 , . „, . , m _ artA 

~- r . l nn — „ »,t,:i ft Alternatively, the tune that the show has been on and 

the TV set 200, To receive a normal broadcast whde 40 rema ining could be shown graphically with, 

using the TV scheduler to record TV programs in the " * , p , , ^ . J ' 

SotadT "put switch K^onnect for bar £«*• 
wtJL 232 to tta TV receiver 200. The VCR 216 can 

with normal TV viewing. . 45 222 is pressed. Usting always starts at the nearest pre vi- 

2. Summary of Keyboard Operation ous half-hour. Note that the pointer always is positioned 

HO. 5 shows the layout of keyboard 220 used in the 6t ***** ^ Street Week, in this 

remote control transmitters 116 and 188 of FIGS. 3 and example.) 
4* The keys 222-244 have the following significance: 50 

MG 222: Master Guide for direct listing and immedi- 
ate selection of program. 

PG 224: Program Guide for setting up stored features 
and accessing help information. 

TV 226; Selects conventional channel selection. 55 

SEL 228: Selects program from menu to be displayed 
on TV 

C 230: Cancels stored program in the PG mode; tog- 
' gles channel restriction on and off in the MG mode. 

f 232: Moves pointer to top of listing; auto scrolls to 60 Note that screen will list 16 lines of program informa- 

previous page if pressed when pointer is on top tion not including the three status lines at the bottom of 

line. the screen. The time remaining could also be shown 

J, 234: Moves pointer to bottom of listing; auto scrolls directly in the 16 lines of program information in the 

to next page if pressed when pointer is on bottom case of programs in progress. The designation "F2" is a 

line. 65 satellite name. As shown, Prime indicates that the lis- 

-♦236: Moves to next page; pointer location un- ting is restricted to hours between 6 pm and 11 pm, 

changed. Wraps to start of week listing when last Theme 2 on indicates that theme group 2 is selected Up 

page is displayed. to 4 groups of theme selection are available to accom- 



9:00 Hotel secies 


Ch7 


News 


Ch 2 


Wall Street Week 


Ch 17 


Movie 


F2,Ca20 


9:15 Movie 


HBO 


9:30 Streets of SF 


Ch2 


Wed Jon 30, Prime 6 pm 11 pm, theme 2 on 


Time: 9:23 PM Channel group 2 an Tune 


remaining: 7rain-, Wall Street Week 
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modate 4 viewers. Channel group 2 restricts listing to 
channels defined under group 2. Four different channel 
groups are provided to accommodate different viewers. 
Up to 5 characters are available to indicate a program 
service by name. 

Keys most commonly used in the MO mode. A com- 
plete detailed explanation follows: 



UP 232, 
DOWN 234 
-> 236 
<- 238 
+ 244 



moves pointer up or down 



SEL 228 

TV 226 

Digits 
246 



10 



15 



20 



moves one page forward 
moves one page backward 
moves one day forward, hour unchanged. 
Wraps around when last day of week is 
reached. 

go to selected program (marked by 
pointer) 

go to conventional manual channel 
selection 

used to set start time of search, else 
start of search will be at the nearest 
hour 

Keys used by advanced users: 

C 230 Toggles channel listing restriction 

P 240 Toggles prime time listing or sets PM 

A 242 Toggles theme listing or sets AM 



25 

3. Detailed Operation in the MG mode When the MG 
key 222 is pressed, the TV screen wfll display a listing of 
programs starting at the nearest full hour. For example, 

if the time is 2:17, the display will start at 2:00. If 
desired, the user can enter the hour when the listing will 30 
start. For example, if 5 is entered, the listing will start at 
5. Note that there is no need to enter an explicit AM or 
PM if the current AM or PM is same as the desired 
listing time. At the bottom of the screen is a two line 
status display, showing the actual time and date, and 35 
whether any of the search restrictions (prime, theme, 
and channel) are activated. If the prime is on, the prime 
time will limit the program listing to the prime time 
(specified by the user in the PG mode). If the start time 
is set to 6 pm, when the MG key 222 is pressed, the 
listing will start at 6 pm if the current time is 6 pm or 
earlier. If the current time is 9:05 pm, and the prime start 
time is 6 pm, then the listing wfll start at 9 pm, since a 
listing starting at 6 pm is not particularly useful. 

. Note* that the user can override the prime time re- 45 
striction by entering an hour digit at any time. The 
listing will immediately start at the override time. Also 
note that for the average user, the prime time need not 
be set, It is set to 6 pm to 11 pm by default when the 
Program Master is first used 

The cursor keys 232-236 can be used to select a dif- 
ferent program. The up/down cursor keys 232-234 will 
move the cursor one line up or one line down at a time. 
When the top or the bottom of the listing is reached, the 
up key 234 will cause the screen to automatically dis- 
play a previous one page, while the down key will cause 
the screen to display the next page. 

To speed up listing, the left and right arrow page keys 
238 and 236 may be used to go back or advance a page 
at a time, respectively. The cursor position is un- 
changed when the page keys 236-238 are used. 

Once a desired program is indicated by the cursor, 
pressing the SEL key 228 will automatically cause the 
Program Master to return to the TV broadcast with the 
channel tuned to the selected program. The MG key 65 
222 may also be used to return to the TV program, prior 
to selection in the MG mode. If the TV key 226 is 
pressed, the TV will return to the last manually selected 
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program. By toggling between the MG and the TV 
modes, it is possible to review two programs without 
having to remember the channel numbers. 

Example of MG Mode 

To start listing at 2 pm, press the following keys: 

MG 222, 2 digit key 246, P 240, SEL 228 

The TV will immediately display the program next to 
the pointer when the SEL key 228 is pressed. 

Pressing the P key 240 is optional; if omitted, the 
listing will be the same as the current PM or AM. 

4. Program Guide (PG) Modes 

For advanced users, the Program Master can be set 
up to list only the types of program (theme), only cer- 
tain channels and only programs within a certain time, 
such as Prime Time. In addition, the Program Master 
can store weekly programs and special programs. The 
stored program can be used to trigger an alarm or en- 
able a VCR without user intervention. The PG mode 
may be used for unattended recording of a series of 
programs by only menu selection, without the user 
having to set the VCR with channel, time, date, or 
length of program. 

Note that the Program Master can be used without 
setting up any of these features. However, much of the 
power of the Program Master is contained in these 
features The PG modes are infrequently used by the 
average user. For advanced users, the PG modes may 
be re-programmed daily. 

There are five sub-modes available when the PG key 
224 is pressed. Each of these modes allows the user to 
customize the program listing. When the PG key 224 is 
first pressed, the following information is displayed at 
the bottom of the screen: 



PG A 


selects the theme setup mode 


PG P 


selects the prime time hours setup mode 


PG C 


selects the restrict channel listing setup 




mode 


PG + 


selects the weekly/special selection setup" 




mode 



PG A Theme Setup 

When the A key 242 is pressed, a list of themes ap- 
pears on the screen. The Up/Down keys 232-234 may 
be used to position the selection cursor next to the 
theme to be added to the list The SEL key 228 is used 
50 to add to the list while the C key 230 can be used to 
cancel a selected theme. As each theme is selected, the 
cursor is enhanced by a marker identifying the themes 
selected. There can be up to 31 themes displayed on two 



55 Some themes, such as sports, have up to 15 sub- 
themes Whenever the cursor is placed alongside a 
theme with sub-categories, as expanded listing appears 
on the right of the screen. These sub-themes may be 
accessed using the two left/right arrow keys 238 and 
60 236 (used for page selection in the MG mode). When 
the right arrow key 236 is pressed the cursor will reposi- 
tion to the top of the sub-themes. One or more sub- 
themes can be selected using the SEL key 228 or elimi- 
nated using the C key 230; To return to the main 
themes, the left arrow key 238 is pressed. Alternatively, 
by pressing the MG key 222, the MG mode can be 
accessed directly. The selection made while in the PG 
A mode will be, permanently stored. 
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The PO key 224 is generally ignored while in the PG 
mode. However, while in the sub-theme listing, the PO 
key 224 will return to the main theme listing. A typical 
theme listing is shown: 



News 


Football 


Movies 


Baseball 


Sports (2) < 


♦Basketball 


Chfldrens Show 


Golf 


Education and Science 


Tennis 


Financial News 


Bowling 


•Special Series (4) 


•Racing 


Travel 


Boating 


Foreign Language 


Hunting 


Game Show 


Special Events 


♦Re-runs (ALL) 




Music 




Theme Group 2 Total no. 


of themes: 3 


Total no of groups setup: 3 





. Enter start time: (hour and A or P) 

Enter end time: 

Current Prime Time is set to; 7 pm - I am 
Press MO, PG again, or TV to exit this mode 
Only the MG key will cause the prime time to be 
modified 



10 



IS 



To enter the start and end time, the user keys in a 
digit key 246 followed by the A key 240 or the P key 
242, indicating AM or PM, If no change is required of 
the start time, the user can skip to the end time by press- 
ing the SEL key 228. Pressing the SEL key 228 twice 
will automatically exit the display back to the MG 
mode. 

After a new time has been set, the current prime time 
on the status line will be changed the next time the user 
accesses the Prime Time mode. Pressing the TV key 
226 or the PO key 224 will inhibit updating of the prime 
To accommodate several viewers with different 20 time. Only the MO key 222 will cause the prime time to 
theme interests, the Program Master has the facility to be modified and stored. 

create up to four theme lists. To create a multiple list, Prime time, when activated, will restrict listing to the 
after PO A is entered, enter a digit (from 1 to 4) immedi- specified hours. In addition, if the current time is inside 
ately. To create another list, the user must exit the PO the prime time, the start of listing will be the nearest 
mode and re-enter PO A with a new digit Note that 25 hour of the current time. For example, if the prime time 
when the user creates a numbered list, the Program is set from 7 pm to 1 1 pm, and the current time is 9:34, 
Master still provides a default mode where all programs then the listing will start at 9:00 pm. 
are Usted (theme off mode). If no numbered list is ere- If the day command (+ key 244) is activated, the 
ated, the Program Master provides only two modes: listing for the next day will always start at the beginning 
theme off and theme on. Again, for the average user, 30 of prime time (7 pm in the above example) for the next 
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this is the most common setup of the theme mode. 

When the MO mode screen is displayed, the theme 
indicator at the bottom of the screen will list the current 
theme number if a numbered theme list exists. Each time 
the A key 242 is pressed, the theme number advances to 
the next theme number. For example, if there are two 
lists, theme 2 and theme 4, each time the A key 242 is 
pressed, the display shows theme 2, then theme 4, then 
no theme (theme off), and then back to theme 2. 

The Program Master will remember the last theme 
setting when the Program Master is turned off, and will 
automatically be set to this mode when the MG key 222 
is pressed. 

Next to each main theme with selected sub-themes is 
a number indicating the number of sub-themes selected. 
If no sub-theme is selected, the Program Master as- 
sumes that all the sub-themes are to be displayed. In this 
case, the indicator will be ALL. 

A sub-theme can be deleted using the C (cancel) key 50 
230 with the cursor pointed at the sub-theme. It is possi- 
ble to cancel all sub-themes by simply cancelling the 
main thex:e, using the same cursor key 232-234/C key 
230 procedure. . 

The status lines give a summary of themes selected. 
Note that since the themes are listed on two pages, the 
summary gives the user some indication of activity of 
the second page. 



day. 

When the last hour specified by prime time is 
reached, the listing will wrap back to the start of prime 
time and will not advance to the next day* 

PO C Channel Restriction List Setup This feature 
allows the user to restrict listing to the channels of 
interest, and also the satellite if it is a satellite broadcast 
As in the case of themes, up to four different channel 
groups can be set up to accommodate different viewers. 
Alternatively, one of the list can be set up for just one or 
two channels of interest. To create a simple list, enter 
PG C The following screen will appear; 
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A. Enter channels or satellite name/symbol 
to be listed: 

a Enter channels or satellite name/symbol 

not to be listed: 

Note that only one of the above is allowed. 
Changing from one to another will automatically 
delete channels of the other list 
Current channels listed: 2, 4> 5, 6. 7, 8, 9, 12, 22 
Press MG, PG again, or TV to exit this mode. 
Only MQ win cause the changes to be updated. 
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To enter channels, press the digit keys 246 and enter 
using the SEL key 228. All single digit channels must be 
preceded by O. A channel can be removed from the list 
by using the paging keys 236-238 to position a marker 
under the channel number to be deleted under the chan- 
60 nel number or channel name to be deleted. Similarly, if 
satellite listing service is requested, satellite names will 
be listed. Satellites, as well as channels, can also be 
deleted from the listing using the C key 230. The C key 
230 will activate the deletion. Each time a channel is 
indicating if the prime time only listing is on or off. By 65 deleted, the marker will advance to the next position to 
default, if the user does not set the prime time, the prime the right of the deleted channel, 
time is automatically set to 6 pm and 1 1 pm. There is When the channel selections are completed, the MO 
only one prime time schedule for all viewers. key 222 must be entered to store the changes. When the 



PO P Prime Time Setup 

This feature allows the user to set up the prime time 
schedule for restricting the listing to only programs 
falling within the prime time. When the MO mode is 
accessed, at the . bottom of the screen is a status line 
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PG C mode is accessed again, the current channel lis- 
ting will reflect the new changes. 

Note that in many cases, the channel not to be listed 
is a much shorter list and therefore preferred over the to 
be listed list. The status line will indicate either the 
channels listed or channels not listed as entered by the 
. user. 

To create multiple lists, follow the PG C entry with 
a number from 1 to 4. Any other number will display a 
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The cursor and page keys 232-238 operation is identi- 
cal to the MO mode except the range is restricted to 
either the upper or lower half of the display. If the 
cursor points to the top of the program listing (line 9), 
the listing will scroll down a half page (eight lines). If 
help screen. When MO is entered, the status will show 10 the cursor points to the bottom of the schedule (line 8), 

the schedule will shift to tne next page. To cross from 



Channel Group n instead of simply Channel ON or 
OFF for a single restriction list. There is always a de- 
fault channel mode where all channels are listed. While 
in the MG mode, each time the C key is pressed, the 
Channel Group number is changed. If there are no more 
Group numbers, then the default channel mode is dis- 
played. 

PG-f Schedule Setup 

This mode allows the user to create a weekly re- 
minder calendar, typically for weekly series and special 
events of non-weekly programs. The reminder process 
will set an alarm if the TV is not on before a certain time 
before the start of the program. If the TV is not on 



schedule to program list, and vice versa, the P key is 
used. The cursor will reposition itself to the top of the 
new selection. 

In the lower listing, the +key 244 operates as in the 
MG mode, advancing the listing by one day at a time. In 
the upper screen, the + key 244 has no effect. 

To add a program to the schedule, use the P key 240 
to toggle the cursor to the program listing (lower half of 
display). Use the cursor, page, or + keys 232-234, 
236-238 or 244 to locate the desired program. Use the 
SEL key 228 to store the program in the schedule. The 
upper screen will immediately display the new addition. 

If the page is full, the Program Master will automati- 

when the program starts, the reminder process will turn cally switch to the next page. If both pages are full, the 
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on the VCR to start recording the program. 

The schedule may be programmed to respond to 
. either a single program of a series or all programs of a 
series. For example, a daily or weekly show may be 
scheduled for a particular day or for all occurrences in 
the program listing. 

The Program Master will automatically link and 
schedule all programs of a series using a linking code 
assigned to all programs of a series by the broadcaster. 
For example, the NBA playoff series which occurs at an 
irregular time and interval may be completely sched- 
uled just by selecting the NBA listing and assigning an 
ALL suffix to the listing. At the end of the series, the 
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status line will show a FULL message. 

To cancel a scheduled program, either to make a 
correction or make room for a new addition, use the P 
key 240 to switch to the upper display. Position the 
cursor to the program to be deleted, using the up/down 
or page keys 232-238. Press the C key 230 to cancel the 
program. 

All changes to the schedule are effective upon press- 
ing SEL or C, and do hot require the MG key 222 to 
initiate update. To exit, use the MG or TV key 222 or 
226. 

During attended operation, when a scheduled pro- 
gram is activated, the name of the program will be 



listing is automatically revised with the suffix, OLD, 40 superimposed onto the TV screen as a subtitle when the 



After one week, the listing wfll automatically be de- 
leted, if the user has not already deleted it If a program 
selection is not followed by the A key 242, the program 
is assumed to be one time only. The A key 242 can be 
pressed at any time to affect ALL responses. 

When the schedule mode is entered, a split screen 
displays the scheduled program on the top eight lines 
and the program list on the bottom eight lines. This 
listing is identical to the MG listing, except that a short 



TV is first turned on. Pressing the TV key 226 will clear 
the subtitle. During an unattended operation, no name 
will be superimposed onto the screen, so that VCR 
recording will not be disturbed. 
45 5. Flow Diagram Description 

The following is a description of the program sequen- 
ces for the CPU 110 in FIG. 3 or the CPU 178 in FIG. 
4. 

Received data from data demodulator 102, FIG. 3 or 



ened listing is displayed instead of 16. All other MG 50 data demodulator 169, FIG. 4, is stored in temporary 



parameters, such as Prime, Channel, and Theme are in 
effect The user should review the MG status before 
setting up the schedule. Up to 16 programs can be en- 
tered in the schedule listing using two pages of display. 
The page keys 232 and 234 are used to access the second 
page. Either the up or down keys 232 and 234 will 
toggle the schedule listing. 
A typical schedule is shown below; 
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Hotel (ALL) Fri 9 pm ch 7 

Dynasty (ALL) Wed 8:30 pm ch 4 

Simon and Simon (ONLY) Mos. 10 pm ch 2 
7:30 News ch 2 

Evening cb 4 

Movie: Prizzi's Honor SHO 
Movie: 2001 AD, ch 19 

8:00 Masterpiece Theater 

Wed Jun 30 5:34 pm Schedule Page 1 (status line) 
Use A to enter ALL; press A again to toggle back to 
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buffer 300 of FIG. 6. The buffer is enabled by the sys- 
tem clock 128, FIG. 3 or 194, FIG. 4 during down time 
of the broadcast In another implementation, the buffer 
300 is always enabled. The ID of the subscriber in ROM 
112 of FIG. 3 or ROM 184 of FIG. 4 is compared with 
the received data, by decision block 301 of FIG. 6 If a 
match is found, the Program Master is ready to receive 
prograniming data. In* another implementation, no ID 
match is required to receive the programming data. 

As each block of data is received, the data integrity is 
verified by error checking logic at 302. If no error ex- 
ists, the received data is stored in the program list buffer 
303, replacing the previous program list data. If an error 
exists and is determined to be correctable at 304, the 
block is corrected at 305 and then stored in the program 
list buffer 303. The block error analysis 302 is based on 
cyclic redundancy coding to correct errors that affect 
short burst errors in a known manner. 
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If the error is determined to be uncorrectable, the If an SEL key entry is detected at 370, the channel of 

number of the uncorrectable block is logged in an error the programmable tuner 132 or 164 will be set to the 

log 306. The receiver is set by 307 in this case to wait for channel listed at 375 at the current cursor position of the 

another complete transmission before terminating the MG display. The MO mode is terminated at 376 and the 
program update. The microcomputer 22 of FIGS. 1 and 5 TV 126 or 200 is switched by the video switcher 140 or 

2 is programmed to repeat transmissions of the program 172 to the tuner 132 or 164. 

list for a number of times to allow for correction of If an MG key 222 entry is detected at 371, the MG 

uncorrectable errors at the receiver 90 or 160 (FIGS. 3 mode is terminated at 176 and the TV 126 or 200 is 

and 4). switched to the channel that was set in the programma- 

When the last decision block 308 detects a last block 10 ble tuner 132 or 164 before the MG mode was activated, 

command in the transmission, update of the program If a P, C or A key 240, 230 or 242 closure is detected 

listing is terminated. The CPU passes control at 309 to at 373, the prime buffer, channel buffer and theme 

the command string processor 310, FIG. 7. buffer are toggled off or on at 377. The screen buffer is 

The command string 310 searches for closure of the cleared at 364, and a new search is commenced with one 
MG key 222 (FIG. 5) at 320, the PG key 224 at 321, or 15 of the search criteria changed 

the TV key 226 at 322. If any other keys are entered If a cursor key 232 or 234 closure is detected at 374, 

before one of these keys, the key is ignored. If the TV the screen cursor will be positioned up or down at 378 

key 226 is entered, the manual TV channel select mode corresponding to the up or down cursor. The screen 

is set up at 323. The Program Guide then functions as a buffer is updated at 353 to reflect the new cursor posi- 
standard remote TV tuner. • 20 tion. 

When a channel is changed at 323, the channel num- Referring to the flow diagram of FIG. 7, if closure of 
ber or name is inserted into the lower half of the screen the PG key 224 is detected at 321, followed by closure 
for a few seconds. Video switcher 172 (FIG. 4) is con- of the A key 242 at 324, the theme mode is selected, 
trolled by line 210. When the TV frame reaches the Referring to FIG. 9, the theme buffer 400 is selected by 
bottom half of the screen, line 210 selects the video 25 the CPU 110 or 178 to output to the video generator 136 
display generator 204 instead of the programmable TV or 204 and displayed on the TV 126 or 200, as indicated 
tuner 164 as its input. The timing to actuate line 210 is at 401. The theme buffer data originates from the re- 
derived from the program data timing controller 168 ceived program fast data. The themes may change over 
and is inputted to the CPU 178 by the data demodulator time as new themes are presented. The status line infor- 
169 output line 182. Other implementations are possible, 30 mation is also displayed on the TV 126 or 200, as indi- 
such as insertion of the channel number or name into the cated at 402. The status line indicates the current PG 
video picture. mode, theme, time, date and also shows the number of 

If the MG key 222 is entered, the MG mode is se- selected themes, 

lected, FIG. 8. Upon entry, the system clock time and If a cursor key 232-234 closure is detected at 403, the 
calendar is stored in the status line buffer 350. The set 35 cursor position is moved up or down one listing at 409 

list pointer 351 is adjusted to the nearest hour based on and the display is updated at 401. If an SEL key 228 

the current time and date. closure is detected at 404, the listing pointed by the 

A search of the program listing 352 is made. The cursor is annotated at 410 and displayed as an asterisk 

search is dependent on the status of the channel buffer, next to the listing. 

the theme buffer, the prime time buffer, and the direc- 40 If a C key 230 closure is detected at 405, any anno- 

. tion of search. If the page 356 is up, the search direction tated theme pointed to by the cursor is deleted at 411. If 

is forward starting from the list pointer. If the page is the theme is not annotated, the C key 230 is ignored, 

down 357, the search direction will be backward 358 Each time a theme is selected or deleted, the number 

from the current list pointer. When the search satisfies of themes selected is determined and the status line 

the above criteria, the program listing is placed into the 45 updated at 402 to reflect the current status, 

screen buffer 353. The search continues until the screen If entry of the digits 1, 2, 3 or 4 keys 246 is detected 

buffer is full 354 in which case the search is terminated. at 406, a new theme buffer is selected at 412 and dis- 

The status lines information is passed to the screen played at 401. 

buffer and displayed 355 by the TV. If an MG key 222 closure is detected at 407, the 
The CPU 110 (FIG. 3) or 178 (FIG. 5) selects the 50 screen is cleared and replaced by the MG mode, FIG. 7. 
screen buffer to drive the video display generator 136 If a TV key 226 closure is detected at 408, the display is 
(FIG. 3) or 204 (FIG. 4), and also operates the video replaced by the TV program selected by the program- 
switcher 140 (FIG. 3) or 172 (FIG. 4) to switch the TV mable tuner 132 or 164 prior to the theme nfode. 
126 (FIG. 3) or 200 (FIG. 4) from the programmable If a key is detected other than any of the above, an 
TV tuner 132 (FIG. 3) or 164 (FIG. 4) to the generator 55 error message is placed in the status line field at 413 
136 or 204. indicating the keys allowed. 

If a digit key 246 (FIG. 5) is detected at 360, the p . 

search time is changed to agree with the digit entered at rnme 

363. If the P or A key is detected at 362» the PM or AM Referring to FIG. 7, if a P key closure is detected at 

of the time will be changed accordingly. The screen 60 325, the prime time mode is selected. Referring to the 

buffer is cleared at 364 and a new search is started with prime time flow chart, FIG. 10, the prime time buffer is 

the list pointer set to the new search time. selected and displayed at 420. The status information for 

If a + key 244 entry is detected at 365, the search the prime mode is also displayed at 421. 

date is incremented at 366, the screen buffer is cleared The prime time entry mode is set up to input the start 

364 and a new search is started with the list pointer set 65 time at 422. If a digit key 246 is detected at 423, fol- 

to the next day. The increment search date at 366 will lowed by either the A or P key 242 or 240, indicating 

return the start of listing date if incrementing will go AM or PM respectively, the digit and am or pm is 

beyond the last date of the programming listing. stored at 428 in the prime screen buffer. If neither A or 
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P is detected, the SEL decision block 424 determines middle of the screen, that is, cross into the other section 
whether the SEL key 228 has been entered If the SEL of the display, 

key 228 is detected, the prime screen buffer will accept If a page key 236-238 is detected at 483, the section 
the digit and store it at 428 with an implied am or pm with the cursor will scroll at 489 forward or backward 
based on the previous am or pm selection. S depending on the page direction. 

When an input is accepted, the entry mode changes If the SEL key 228 is detected at 484, and if the cur- 
from the start time to the end time at 429. The end entry sor is located in the program list section at 490, the 
sequence is the same as the start, except when the screen listing pointed to by the cursor will be computed for 
is updated, the prime mode exits to the MG display. The non-conflict with existing listing. If the desired new 
new prime time is now displayed on the MO status line. 10 listing schedule overlaps or conflicts with the existing 

If none of SEL, A or P 228, 242, 240 are detected at listing, a warning message will appear in the status line 
424, and the key closure is not MG 222 or TV 226, as field. The user is required to enter the SEL key 228 a 
detected at 426 and 427, then a prime mode error mes- second time to update the schedule. If the warning 
sage is displayed at 430. The message is inserted into the message is ignored, the latter entry will not be sup* 
status line indicating the valid keys that can be entered. 15 ported for purposes of unattended VCR operation. 

If the MG or TV key 222 or 226 is detected, the result Thus, the user is informed of a possible error before 
is the same as for the theme mode. unattended recording is started. 

rh - When the SEL key 228 is entered, the selected Kst is * 

unannei copied to the end of the schedule section at 491 If the 

Referring to the command string flow diagram, FIG. 20 schedule section is full, the status line will indicate that 
7, the channel mode is selected if the C key 230 is de- a schedule listing must be deleted to make room for the 
tected at 326. Referring to the channel flow diagram, new listing. When a list is changed, the display is up- 
FIG. 11, the channel screen buffer 450 is selected by the dated at 480. 

CPU 110 or 178 to be displayed at 451 on the TV 126 or If the C key 230 is detected at 485, and if the cursor 
200. 25 is located in the schedule list section, determined at 492, 

Status information for the channel mode is displayed the listing pointed to by the cursor will be removed at 
at 452 with the channel information. If the cursor keys 493 and the remaining listings wfll be shifted forward by 
232-234 are detected at 453, the entry list switches from one listing to fill the gap left by the deleted listing, 
channels to be displayed to channels not to be displayed If the key is MG 222 or TV 226, as determined at 486 
at 459. 30 and 487 the result is the same as for the theme mode 

If a digit key 246 is detected at 454, the CPU 110 or discussed above. 
178 waits for an SEL key 228 entry at 460 to enter the If an invalid key is entered, a schedule error message 
data into the channel screen buffer at 461. will appear in the status line at 494. 

If a page key 236-238 is detected at 455, an underline Finally in the command string flow diagram, FIG. 7, 
marker will be positioned under the first channel num- 35 if a key closure other than the above keys described for 
ber entry at 462. If the following key is a C (cancel) key steps 324-327 is detected, a PG error message will be 
230, detected at 463, the underlined channel will be generated at 328. 
deleted from the channel screen buffer at 464. If it is not A1 , _ T . . 

a C key 230, the CPU 110 or 178 will wait for another Ahma md Unattended Recording 

key at 455. If another page key 236-238 is entered, the 40 Referring to the alarm flow chart, FIG. 13, a sched- 
underKne will move to the next channel number listed at ule search is made once a minute at 500. If the system 
462. Thus the page keys 236-238 may be used to point clock time is within the schedule time at 501, the TV set 
at a channel to be deleted. ' 126 or 200 is tested to see if it is on or off at 502. If the 

If an invalid key is entered (none of the above keys, TV 126 or 200 is on, a sub-title showing the name of the 
MG 222 or TV 226, tested at 456 and 457 respectively), 45 scheduled list that produced the alarm will be displayed 
an error message for the channel mode will be displayed at 508. If the TV key 226 is detected at 509, the sub-title 
on the status line at 458 indicating the required valid will be deleted at 510. If the TV key 226 is not detected 
keys. when the scheduled program is active, the alarm 156 or 

Referring again to the command string flow diagram, 217 will be sounded at 511. 
FIG. 7, if the + key 244 is detected at 327, the schedule 50. If the TV 126 or 200 is not on at 502, the alarm 156 or 
mode is selected. Referring to the schedule flow dia- 217 will be sounded five minutes before the start of the 
gram, FIG. 12, the CPU 110 or 178 selects the schedule scheduled program at 503. If the TV is still not on at 
screen buffer to be displayed on TV 126 or 200 when 504, the programmable tuner 132 of FIG, 3 or 164 of 
the schedule mode is enabled. The schedule is presented FIG. 4 will be set to the scheduled program at 505. The 
on the upper half of the screen at 480. 55 VCR 150 or 216 will be turned on by a signal on line 154 

The program listing is presented on the lower half of or line 218, respectively, to record the program at 506. 
the screen at 481. The remaining time for each listed At the end of the program at 507, a new search is corn- 
program is computed by referencing against the current menced at 500. 

time and the length of program time. If the P key 240 is For unattended recording with the TV scheduler 160 
detected at 482, the cursor moves from the listing sec- 60 of FIG. 4B, turn on of the remote VCR 216 is accom- 
tion to the schedule section of the screen. The P key 240 plished by means of the remote controller 1010 con- 
is used to toggle the cursor between the two sections at nected to the TV scheduler 160. Turn-on, record and 
488. turn-off are all actuated remotely as described above in 

If a cursor key 232-234 is detected at 483, the cursor connection with FIG. 4B. 
will be positioned at 489 a line at a time as in the MG 65 _ . _ 

display. However, instead of causing the screen to Broadcast Format 

scroll when the cursor reaches the bottom of the screen, Each program listing is framed with the following 
scrolling starts when the cursor attempts to cross the information; 
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Start time 


hour, minute 


Duration of program 


hour, minutes 


Channel number 


two digits 


Tbeme classification 


number 


two digits 


Theme subdassification 


number 


two digits 


Linking number (only for 


serial shows) 


three digits 


Optional expanded listing 


text up to 300 




characters 


End of Program 


single f^hff meter 


Satellite symbol 


two characters 


Satellite name 


five characters 


Encrypted and any special 




broadcast indicators 


one character 



Program listings are contained within a variable 
length data block of about 1,000 bytes. Each block 
includes CRC codes to allow correction of short burst 
errors of up to six characters. 

The systems shown in FIGS. 1-4 are preferably im- 
plemented with the commercially available subsystems 
shown in the following table. 



Reference Nos. 


Subsystem 


Source 


22 


IBM PC/AT 


IBM Corporation, 






Boca Raton, Florida 


26,102, 169 


Hayes Sraartmodem 


Hayes Microcomputer 




1200 


Products, Norcross 






Ocorgia 


106, 180 


Little Board/186 


Ampro Computers, Inc. 




Microcomputer 


Mountain View, 






California 


116, 388 


Remote Control 


Semens 




Transmitter Model 


Iselin, NJ. 




SDA 2209-2 




118, 190 


Remote Control 


Siemens 




Receiver Model 






SAB 4209 




126,200 


Sony KV-26TOR with 


Sony Corp. 




auxilliary input 


New York, N.Y. 


132,164 


Programmable Tuner 


Siemens 




SA210 




98 


Quotrex FM/SCA 


Data Speed, San Mateo, 




Receiver 


California 


136,204 


Motorola CRT 


Motorola, Inc. 




Controller MC684S 


Austin, Texas 


1010, 1020 


JVC Model RM-P67U 


JVC Co. of America 




Wireless Remote 


Hrowood Park, NJ. 




Control 



sonal computer through an information utility, such as 
Compuserve or The Source, and the user could either 
make the selection inputs to the utility's mainframe for 
running a selection program on the mainframe and then 
5 download the selected program information, or down- 
load the program schedule information for his or her 
locality, then run the selection program with the down- 
loaded program schedule information on the personal 
computer. The television set and VCR could then be 
10 controlled as peripherals of the personal computer. 
Alternatively, the user could employ the selected pro- 
gram information from the personal computer to con- 
trol the television receiver or VCR manually in the 
process of this invention. A diskette containing broad- 
15 cast information could be used instead of a direct broad- 
cast as an input to the TV sobeduler. The diskette can 
be read by a computer that controls a programmable 
TV tuner. The TV scheduler can be used to control a 
satellite programmable tuner as well as a TV program- 
mable tuner. If the user selects a listing of a program 
that is broadcast by satellite, the scheduler will automat- 
ically set the satellite tuner, as well as the TV tuner, to 
correspond to the selected listing. It is intended that 
such changes be included within the spirit and scope of 
the claims appended hereto. 
What is claimed is: 

1. A system for controlling a television receiver to 
allow user selection of broadcast programs from sched- 
ule information, which comprises a data processor, a 
first input means for the schedule information con- 
nected to said data processor, a second user selection 
input means connected to said data processor, said data 
processor being configured to select programs from the 
schedule information based on user inputs, storage 
means connected to receive the schedule information 
for programs selected by said data processor, and a 
programmable tuner for connection to the television 
receiver, said programmable tuner being connected to 
40 receive control signals from said data processor at a 
time of a selected broadcast for causing said program- 
mable tuner to supply broadcast signals for the selected 
program to the television receiver, said data processor 
being configured to supply an actuating signal to a pro- 
gram recorder at the time of a broadcast program se- 
lected by said data processor and to supply the broad- 
cast signal for the selected program to said program 
recorder, said system being configured to allow said 
television receiver to receive a different program than 
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It should now be readily apparent to those skilled in 
the art that a novel electronic system and process for 

controlling a television receiver to allow user selection 50 the broadcast signal for the selected program supplied 



of broadcast programs from schedule information capa- 
ble of achieving the stated objects of the invention has 
been provided. The system and process of this invention 
allows the user to supply selection criteria to the system 
and in the process that can be combined to search a 
substantial quantity of schedule information received as 
a broadcast or otherwise supplied to the system to 
choose programs meeting the selection criteria. The 
system and process of this invention will determine if 



to said program recorder. 

2. The system of claim 1 additionally comprising a 
video display generator connected to receive signals 
from said data processor for generating a video display 
55 from the schedule information and the user selections 
on the television receiver, and a video switcher con- 
nected to receive video display signals from said video 
display generator, broadcast program signals from said 
programmable tuner and control signals from said data 



the viewer's television set is turned on at the time of a 60 processor for selecting between the video display sig- 



selected broadcast program, and will automatically 
record the selected program on a VCR or other pro- 
gram recording device if the television set is not turned 
on. . _ 

It shoiu^ former be apparent to 65 
that various'changes in form and details of the invention 
as shown and described may be made. For example, the 
schedule information could be^accessible with a per- 



nals and the broadcast program signals for supplying to 
the television receiver. 

3. The system of claim 2 in which said data processor 
and said video display generator are further configured 
to display names of program services in the schedule 
information. 

4. The system of claim 2 in which said data processor 
and said video display generator are further configured 
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to present a preselected portion of the schedule infor- programmable tuner for connection to the television 
mation for the user selection. receiver, said programmable tuner being connected to 

5. The system of claim 1 in which the schedule infor- receive control signals from said data processor at a 
mation is also broadcast and said first input means com* time of a selected broadcast for causing said program* 
prises a broadcast signal receiver connected to supply 5 mable tuner to supply broadcast signals for the selected 
the broadcast schedule information to said data proces- programs to the television receiver, said data processor 
sor, being configured to provide signals to said video dis- 

6. The system of claim 5 in which said broadcast play generator for presenting a plurality of user selec- 
signal receiver is a frequency modulation receiver con- tion menus on the television receiver, and said second 
figured to receive the broadcast schedule information 10 user selection input means includes a plurality of keys 
independently of the broadcast programs, said first for making selections from the menus for choosing 
input means includes a data demodulator connected to programs from the schedule information, said data pro- 
supply the schedule information to said data processor, cessor being configured to allow combinations of the 
said frequency modulation receiver being connected to menu selections for choosing programs from the sched- 
supply the broadcast schedule information to said data IS ule information. 

demodulator. 13. A system for controlling a television receiver to 

7. The system of claim 5 in which the schedule infor- allow user selection of broadcast programs from sched- 
mation is broadcast in an otherwise unused portion of a ule information, which comprises a data processor, a 
television program broadcast, said programmable tuner first input means for the schedule information con- 
includes said broadcast signal receiver, said first input 20 nected to said data processor, a second user selection 
means includes a data demodulator connected to supply input means connected to said data processor, said data 
the schedule information to said data processor, and processor being configured to select programs from the 
said programmable tuner is connected to supply the schedule information based on user inputs, storage 
schedule information portion of the television program means connected to receive the schedule information 
broadcast to said data demodulator. 25 for programs selected by said data processor, and a 

8. The system of claim 1 in which said data processor programmable tuner for connection to the television 
is further configured to supply an actuating signal to a receiver, said programmable tuner being connected to 
program recorder at the time of a broadcast program receive control signals from said data processor at a 
selected by said data processor and to supply the broad- time of a selected broadcast for causing said program- 
cast signal for the selected program to said program 30 mable tuner to supply broadcast signals for the selected 
recorder. programs to the television receiver, said data processor 

9. The system of claim 1 additionally comprising a being configured to supply an actuating signal to a pro- 
video display generator connected to receive signals gram recorder at the time of a broadcast program se- 
from said data processor for generating a video display iected by said data processor and to supply the broad- 
from the schedule information and the user selections 35 cast signal for the selected program to said program 
on the television receiver, and a video switcher con- recorder, said data processor being configured to re- 
nected to receive video display signals from said video ceive an input signal for determining whether the televi- 
display generator, broadcast program signals from said sion receiver is operating at the time of the broadcast 
programmable tuner and control signals from said data program selected by said data processor and to supply 
processor for selecting between the video display sig- 40 the actuating signal to said program recorder unless the 
nals and the broadcast program signals for supplying to television receiver is operating. 

the television receiver, and in wlhich the schedule infor- 14. A system for controlling a television receiver to 
mation is also broadcast and said first input means com- allow user selection of broadcast programs from sched- 
prises a broadcast signal receiver connected to supply ule information, which comprises a data processor, a 
the broadcast schedule information to said data proces- 45 first input means for the schedule information cen- 
sor, nected to said data processor, a second user selection 

10. The system of claim 9 in which said data proces- input means connected to said data processor, said data 
sor is further configured to provide signals to said video processor being configured to select programs from the 
display generator for presenting a plurality of user se- schedule information based on user inputs, storage 
lection menus on the television receiver, and said sec- 50 means connected to receive the schedule information 
ond user selection input means includes a plurality of for programs selected by said data processor, and a 
keys for making selections from the menus for choosing programmable tuner for connection to the television 
programs from the schedule information. receiver, said programmable tuner being connected to 

11. The system of claim 1 in which said programma- receive control signals from said data processor at a 
ble tuner receives both the schedule information and the 55 time of a selected broadcast for causing said program- 
broadcast signals for the selected programs, said pro- mable tuner to supply broadcast signals for the selected 
grammable tuner being connected as part of said first programs to the television receiver, said data processor 
input means. being configured to supply an actuating signal to a pro- 

12. A system for controlling a television receiver to gram recorder at the time of a broadcast program se- 
allow user selection of broadcast programs from sched- 60 lected by said data processor, said data processor being 
ule information, which comprises a data processor, a connected to a remote controller for said program re- 
first input means for the schedule information con- corder to supply control signals to said remote control- 
nected to said data processor, a second user selection ler for recording of the selected program. 

input means connected to said data processor, said data 15, A system for controlling a television receiver to 
processor being configured to select programs from the 65 allow user selection of broadcast programs from sched- 
schedule information based on user inputs, storage ule information, which comprises a data processor, a 
means connected to receive the schedule information first input means for the schedule information con- 
for programs selected by said data processor, and a nected to said data processor, a second user selection 
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input means connected to said data processor, said data 18, A process for controlling the presentation of 
processor being configured to select programs from the broadcast programs to a television receiver, which 
schedule information based on user inputs, storage comprises supplying program schedule information to a 
means connected to receive the schedule information data processor, supplying user program selection crite- 
for programs selected by said data processor, and a 5 ria to the data processor, combining user selection crite- 
programmable tuner for connection to the television ria, selecting those programs meeting the combined user 
receiver, said programmable tuner being connected to selection criteria for viewing from the program sched- 
receive control signals from said data processor at a ule information in the data processor, storing informa- 
tirae of a selected broadcast for causing said program- tion identifying the selected programs, and using the 
mable tuner to supply broadcast signals for the selected 10 a* 01 ^ information to tune the television receiver to the 
programs to the television receiver, said data processor selected programs- 
being configured to supply an actuating signal to a pro- * 9 - Th« process of claim 18 in which the television 
gram recorder at the time of a broadcast program se- receiver is used as a display by the data processor for 
lected by said data processor and to supply the broad- presenting messages to the user during the process, 
cast signal for the selected program to said program 15 ^ ^ Process of claim 19 in which names of pro- 
recorder, the broadcast signals including end of pro- S^am services are displayed in the schedule information, 
gram information for at least programs of uncertain , 21 ^ process of claim 19 in which only a prese- 
duration, and said data processor being configured to P°rt"> n <* * e scheduJe Herniation is presented 

terminate recording by the program recorder in re- _ for toeuser selection. 

sponse to the end of program information. 20 » ™* 18 m * of 

16. A system for controlling a television receiver to ^ sdcctK * m ™ p g* t0 * c P ro ~ 
allow user selection of broadcast programs from sched- ~* P^tmg amenu from the date processor on 
ule information, which comprises a date processor, a aItowlng * SeleCt m **" 

first input means for the schedule information con- „ %, _ „, „„ „, . . - B ^ „„ . . 

nected to said data processor, a second user selection 25 M ' ™? P S <• ° awn J* K fil ? her com ? *» 
ucwwu «« B»u uwi««««ri,o °~ v " u .j " " steps of checking for a conflict between a selected pro- 
input means connected to said date processor, saod data ^ Md a pl J ovsly elected program and providing 
processor bong configrired to select programs from the £ indication to the user of such conflict, 
schedule information based on user inputs, storage u ^ ^ of claim M m which ^ pTOgnm 
means connected to receive the schedule information 30 schedD]e formation is supplied to the data processor 
for programs selected by said data processor, and a broadcast 

programmable tuner for connection to the television 25. The process of claim 24 in which the program 
receiver, said propumnable tuner being connected to schedule information is supplied as a separate broadcast 
receive control signals from said data processor at a f[om ^ program broadcasts, 
time of a selected broadcast for causing ; said program- 35 26, The process of claim 24 in which the television 
mable tuner to supply broadcast signals for the selected receiver is used as a display by the data processor for 
programs to the television receiver, the schedule infor- presenting messages to the user during the process, 
mation including linking information to identify multi- 27. The process of claim 26 in which at least some of 
pie programs of a single series and said data processor fte user selection criteria are supplied to the data pro- 
being configured to select the multiple programs of the 40 by presenting a menu from the data processor on 
single series on the basis of the linking information in a display and allowing the user to select an item from 
response to user selection of one of the programs in the the menu. 

single series, 28. The process of claim 27 further comprising the 

17. A system for controlling a television receiver to s t e ps of checking for a conflict between a selected pro- 
allow user selection of broadcast programs from sched- 45 gram and a previously selected program and providing 
ule information, which comprises a data processor, a an indication to the user of such conflict, 

first input means for the schedule information con- 29. The process of claim 28 further including the 
nected to said data processor, a second user selection steps of providing linking information to identify multi- 
input means connected to said data processor, said data pie programs of a single series and selecting the multiple 
processor being configured to select programs from the 50 programs of the single series on the basis of the linking 
schedule information based on' user inputs, storage information in response to user selection of one of the 
means connected to receive the schedule information programs in the single series. 

for programs selected by said data processor, and a 30. The process of claim 29 additionally comprising 
programmable tuner for connection to the television the steps of using the data processor to turn on a broad- 
receiver, said programmable tuner being connected to 55 cast program recording device for a selected broadcast 
receive control signals from said data processor at a program and recording the selected broadcast program 
time of a selected broadcast for causing said program- on the program recording device, 
mable tuner to supply broadcast signals for the selected 31. The process of claim 24 in which the program 
programs to the television receiver, said data processor schedule information and the programs are broadcast 
being configured to receive an input signal for deter- 60 together, the process additionally comprising the step 
mining whether the television receiver is operating of separating the program schedule information from 
prior to the time of a broadcast program selected by the programs for supplying the program schedule infor- 
said data processor, said system further comprising an mation to the data processor, 
alarm connected to recdve an actuating signal from said 32. A process for controlling the presentation of 
data processor, and said data processor being config- 65 broadcast programs to a television receiver, which 
ured to provide the actuating signal to said alarm unless comprises supplying program schedule information to a 
the television receiver is operating when said data pro- data processor, supplying user program selection crite- 
cessor checks the television receiver for operation. ria to the data processor, using the user selection criteria 
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to select programs for viewing from the program sched- 37. A process for controlling the presentation of 
ule information in the data processor, storing informa- broadcast programs to a television receiver, which 
tion identifying the selected programs, using the stored comprises supplying program schedule information to a 
information to tune the television receiver to the se- data processor, supplying user program selection crite- 
lected programs, using the television receiver as a dis- 5 ria to the data processor, using the user selection criteria 
play by the data processor for presenting messages to to select programs for viewing from the program sched- 
the user during the process, including time remaining ule information in the data processor, storing informa- 
for a program being broadcast tion identifying the selected programs, using the stored 

33. A process for controlling the presentation of information to tune the television receiver to the se- 
broadcast programs to a television receiver, which 10 lected programs, providing linking information to iden- 
comprises supplying program schedule information to a ay multiple programs of a single series and selecting 
data processor, supplying user program selection cnte- ^ mu itiple programs of the single series on the basis of 
ria to the data processor, using the user selection criteria ^ ]h]dng information in response to user selection of 
to select programs for viewing from the program sched- one of the programs in the single series. 

ule information in the date processor, storing ; informa- 15 ^ A rocess for controllmg & presentation of 
tion identifying the selected programs, using die stored broadcast program8 to a tclevision which 
information to tune the television receiver to the se- • „ eM^.ii- j„r«* mn +;r m Q 

lected programs, turning on a broadcast program re- ?? pnse8 program schedule information to a 

_ F*ye iam * lUillUi f ! p data processor, supplying user program selection crite- 

cordrag device for a selected broadcast program, re- ^ * n ^ A ^ L^lL' JSL J^L, •„ 

cording the selected broadcast program, and supplying 20 " a to the data processor using fora selection criteria 
,™ 6 I r , ; F . ~~ awpi/ymft *u to select programs for viewing from the Droeram sched- 

a different program broadcast signal to the television infrt Z^r£ f L H *tl J^t^A^. 

receiver than the broadcast signal for the selected pro- ? P rocessor ' 8 ^ m forma- 

gram supplied to the program recording device. fS^S^S ** ^J™** ^ 

34. A process for controlling the presentation of ^ atl0n *> *»? ^vision receiver to the se- 
broadcast programs to a television receiver, which 25 lect ^ Programs, determming whether the television 
comprises supplying program schedule information to a recewer = P nor 10 *■* °' a 

data processor, supplying user program selection crite, program selected by the process and providing an alarm 
ria to the data processor, using the user selection criteria F** 1 *° **» s ** televis ! on ™™ V ? T ™ °P erat - 

to select programs for viewing from the program sched- m « when *" television receiver is checked for opera- 
ule information in the data processor, storing informa- 30 A . „. f . 

tion identifying the selected programs, using the stored „ 39 ' A * or controlling a television receiver to 

information to tune the television receiver to the se- allow user selection of broadcast programs from sched- 
lected programs, turning on a broadcast program re- ^ "formation, which comprises a data processor, a 
cording device for a selected broadcast program, re- m P ut means for ^ schedule information con- 

cording the selected broadcast program, broadcasting 35 n ected to said data processor, a second user selection 
end of program information for at least programs of m P ut 0168318 connected to said data processor, said data 
uncertain duration, and terminating recording by the Processor being configured to select programs from the 
program recording device in response to the end of schedule information based on user inputs, storage 
program information. means connected to receive the schedule information 

35. A process for controlling the presentation of 40 for programs selected by said data processor, and a 
broadcast programs to a television receiver, which programmable tuner for connection to the television 
comprises supplying program schedule information to a receiver, said programmable tuner being connected to 
data processor, supplying user program selection crite- receive control signals from said data processor at a 
ria to the data processor, using the user selection criteria time of a selected broadcast for causing said program- 
to select programs for viewing from the program sched- 45 ro^te tuner to supply broadcast signals for the selected 
ule information in the data processor, storing informa- programs to the television receiver, a video display 
tion identifying the selected programs, using the stored generator connected to receive signals from said data 
information to tune the television receiver to. the se* processor for generating a video display from the 
lected programs, turning on a broadcast program re- schedule information and the user selections on the 
cording device for a selected broadcast program, re- 50 television receiver, and a video switcher connected to 
cording the selected broadcast program, detennining receive video display signals from said video display 
whether the television receiver is operating at the time generator, broadcast program signals from said pro- 
of the selected broadcast program and turning on the grammable tuner and control signals from said data 
recording device and recording the selected broadcast processor for selecting between the video display sig- 
program unless the television receiver is operating. 55 nals and the broadcast program signals for supplying to 

36. A process for controlling the presentation of the television receiver, the schedule information also 
broadcast programs to a television receiver, which being broadcast, said first input means comprising a 
comprises supplying program schedule information to a ' broadcast signal receiver connected to supply the 
data processor, supplying user program selection crite- broadcast schedule information to said data processor, 
ria to the data processor, using the user selection criteria 60 said data processor being configured to provide signals 
to select programs for viewing from the program sched- to said video display generator for presenting a plurality 
ule information in the data processor, storing informa- of user selection menus on the television receiver, said 
tion identifying the selected programs, using the stored second user selection input means including a plurality 
information to tune the television receiver to the se- of keys for making selections from the menus for choos- 
lected programs, turning on the program recording 65 ing programs from the schedule information, said data 
device, and recording the selected program by supply- processor being configured to allow combinations of 
ing control signals to a remote controller for the pro- the menu selections for choosing programs from the 
gram recording device. schedule information. 
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40. The system of claim 39 in which the schedule tion input means includes a plurality of keys for making 
information includes linking information to identify selections from the menus for choosing programs from 
multiple programs of a single series and said data pro- the schedule information. 

cessor is further configured to select the multiple pro- 49. The system of claim 48 in which said data proces- 
grams of the single series on the basis of the linking 5 sor is further configured to allow combinations of the 
information in response to user selection of one of the menu selections for choosing programs from the sched- 
programs in the single series. m ule information. 

41. The system of claim 40 in which said data proces- 50. The system of claim 42 m which said programma- 
sor is further configured to supply an actuating signal to ble tuner receives both the schedule information and the 
a program recorder at the time of a broadcast program 10 broadcast signals for the selected programs, said pro- 
selected by said data processor. . grammable tuner being connected as part of said first 

42. A system for controlling a recording device to input means. 

allow user selection of broadcast programs from sched- 51. A system for controlling a recording device to 
ule information, which comprises a data processor, a allow user selection of broadcast programs from sched- 
first input means for the schedule information con- IS ule information, which comprises a data processor, a 
nected to said data processor, a second user selection first input means for the schedule information con- 
input means connected to said data processor, said data nected to said data processor, a second user selection 
processor being configured to select programs from the input means connected to said data processor, said data 
schedule information based on user inputs, storage processor being configured to select programs from the 
means connected to receive the schedule information 20 schedule information based on user inputs, storage 
for programs selected by said data processor, a pro- means connected to receive the schedule information 
grammable tuner for connection to the recording de- for programs selected by said data processor, a pro- 
vice, said programmable tuner being connected to re- grammable timer for connection to the recording de- 
ceive control signals from said data processor at a time vice, said programmable tuner being connected to re- 
of a selected broadcast for causing said programmable 25 ceive control signals from said data processor at a time 
tuner to supply broadcast signals for the selected pro- of a selected broadcast for causing said programmable 
grams to the recording device, and a television receiver, tuner to supply broadcast signals for the selected pro- 
said system being configured to allow said television grams to the recording device, said data processor 
receiver to receive a different program than the broad- being connected to a remote controller for said record- 
cast signal for the selected program supplied to said 30 ing device to supply control signals to said remote con- 
recording device. troll er for powering on said recording device, starting 

43. The system of claim 42 additionally comprising a and stopping recording of the selected program and 
display means connected to receive signals from said powering off said recording device. 

data processor for generating a display from the sched- 52. A system for controlling a recording device to 
ule information and the user selections on said display 35 allow user selection of broadcast programs from sched- 
means. ule information, which comprises a data processor, a 

44. The system of claim 43 in which said data proces- first input means for the schedule information con- 
sor and said display means are further configured to nected to said data processor, a second user selection 
present a preselected portion of the schedule informa- input means connected to said data processor, said data 
tion for the user selection. 40 processor being configured to select programs from the 

45. The system of claim 43 in which the schedule schedule information based on user inputs, storage 
information is broadcast and said first input means com- means connected to receive the schedule information 
prises a broadcast signal receiver connected to supply for programs selected by said data processor, a pro- 
the broadcast schedule information to said data proces- grammable tuner for connection to the recording de- 
sor. 45 vice, said programmable tuner being connected to re- 

46. The system of claim 45 in which said broadcast ceive control signals from said data processor at a time 
signal receiver is a frequency modulation receiver con- of a selected broadcast for causing said programmable 
figured to receive the broadcast schedule information tuner to supply broadcast signals for the selected pro- 
independently of the broadcast programs, said first grams to the recording device, the broadcast signals 
input means includes a data demodulator connected to 50 including end of program information for at least pro- 
supply the schedule information to said data processor, grams of uncertain duration, and said data processor 
said frequency modulation receiver being connected to being configured to terminate recording by the record- 
supply the broadcast schedule information to said data ing device in response to the end of program informa- 
demodulator. tion. 

47. The system of claim 45 additionally comprising a 55 53. A system for controlling a recording device to 
television receiver, and in which the schedule informa- allow user selection of broadcast programs from sched- 
tion is broadcast in an otherwise unused portion of a ule information, which comprises a data processor, a 
television program broadcast, said programmable tuner . first input means for the schedule information con- 
includes said broadcast signal receiver, said first input nected to said data processor, a second user selection 
means includes a data demodulator connected to supply 60 input means connected to said data processor, said data 
the schedule information to said data processor, and processor being configured to select programs from the 
said prognmimable tuner is connected to supply the schedule information based on user inputs, storage 
schedule information portion of the television program means connected to receive the schedule information 
broadcast to said data demodulator. for programs selected by said data processor, a pro- 

48. The system of claim 43 in which said data proces- 65 grammable tuner for connection to the recording de- 
sor is further configured to provide signals to said dis- vice, said programmable tuner being connected to re- 
play means for presenting a plurality of user selection ceive control signals from said data processor at a time 
menus on said display means and said second user selec- of a selected broadcast for causing said programmable 



31 



4,706,121 



tuner to supply broadcast signals for the selected pro- 
grams to the recording device, the schedule information 
including Unking information to identify multiple pro- ^ 
grams of a single series and said data processor being 
configured to select the multiple programs of the single S 
series on the basis of the linking information in response 
to user selection of one of the programs in the single 
series. 

54. A system for controlling receipt of broadcast 
television programs to allow user selection of broadcast 10 
programs from broadcast schedule information, which 
comprises a data processor, a programmable tuner con- 
figured to receive both the broadcast programs and the 
broadcast schedule information connected to said data 
processor, means connected between said prograznma- 25 
ble tuner and said data processor for separating the 
broadcast schedule information from the broadcast pro- 
grams and supplying the broadcast schedule informa- 
tion to said data processor, a user selection input means 
connected to said data processor, said data processor 20 
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being configured to select programs from the schedule 
information based on user inputs, storage means con- 
nected to receive the schedule information for pro- 
grams selected by said data processor, said programma- 
ble tuner being connected to receive control signals 
from said data processor at a time of a selected broad- 
cast for causing said programmable tuner to supply 
signals for the selected broadcast programs to at least 
one signal receiver for the selected broadcast programs. 

55. The system for controlling receipt of broadcast 
television programs of claim 54 in which said at least 
one signal receiver comprises a recording device. 

56. The system for controlling receipt of broadcast 
television signals of claim 55 in which said at least one 
signal receiver additionally comprises a television, and 
said system additionally comprises a means for switch- 
ing between said recording device and said television 
for receiving the signals for the selected broadcast pro- 
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[57] ABSTRACT 

A system (90) controls a television receiver (126) to 
allow user selection of broadcast programs from sched- 
ule information. A data processor (110) is connected to 
receive the schedule information from an FM receiver 
(94), decoder (98) and data demodulator (102). A user 
remote control transmitter 116-remote receiver (118) 
combination supplies user selection inputs to the data 
processor (110). The data processor (110) selects pro- 
grams from the schedule information based on the user 
inputs. The schedule information for the selected pro- 
grams is stored in a memory (111), and is used by the 
data processor (110) to control a programmable TV 
tuner (132) to provide the broadcast signals for the 
selected programs to the TV receiver (126) at the time 
of broadcast. The system (90) can also be used to con- 
trol a VCR (150) for unattended recording of the se- 
lected programs. 
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REEXAMINATION CERTIFICATE 
ISSUED UNDER 35 U.S.C 307 

THE PATENT IS HEREBY AMENDED AS 
INDICATED BELOW, 

Matter enclosed in heaty brackets £J appeared in the 
patent, but has been deleted and is no longer a part of the 
patent; matter printed In Italics Indicates additions made 
to the patent 

ONLY THOSE PARAGRAPHS OF THE 
SPECIFICATION AFFECTED BY AMENDMENT 
ARE PRINTED HEREIN. 

Column 7, lines 33-59: 

FIG. 3 is a block diagram of a receiver and television 
receiver control system 90 which is used in combination 
with the FM transmitter system 20 of FIG. 1. An FM 
antenna 92 receives the broadcast signals from the sys- 
tem 20, which are supplied to FM receiver 94 on line 96. 
FM receiver 94 supplies the FM broadcast signals to an 
SCA subcarrier decoder 98 on line 100. The decoder 98 
strips the schedule information signals from the FM 
broadcast signals and supplies the schedule information 
signals to a data demodulator 102 on line 104. The data 
demodulator 102 converts the schedule information 
signals to digital form and supplies the digital schedule 
data signals to system control unit 106 on line 108, more 
particularly, to CPU 110 of the system control unit 106. 
A memory 111 is connected to the CPU 110 at 113. A 
control program for the system control unit 106 and a 
user identification code are stored in a read only mem- 
ory (ROM) 112. ROM 112 communicates with the CPU 
110 on line 114. Other inputs to the CPU 110 are sup- 
plied by a remote transmitter controller 116-remote 
receiver 118 combination on line 120, which supplies 
user selection and other user inputs to the CPU 110, and 
on line 122, connected to power input 124 of television 
receiver 126, which allows CPU 110 to determine if the 
receiver 126 is turned on. System clock 128 of the sys- 
tem control unit 106 is connected to the FM receiver 94 
by line 130. 

Column 1 5, lines 19*31; 

PG+ Schedule Setup 

This mode allows the user to create a weekly re- 
minder calendar schedule stored in memory, typically for 
weekly series and special events of non-weekly pro*- 
grams. The reminder process will set an alarm if the TV 
is not oh before a certain time before the start of the 
program. If the TV is not on when the program starts, 
the reminder process will turn on the VCR to start 
recording the program. 

The reminder calendar schedule may be programmed 
to respond to either a single program of a series or all 
programs of a series. For example, a daily or weekly 
show may be scheduled for a particular day or for all 
occurrences in the program listing. 

Column 15, lines 46-58: 

When the schedule mode is entered, a split screen 
displays the scheduled program on the top eight lines 
and the program list on the bottom eight lines. This 
listing is identical to the MG listing, except that a short- 
ened listing is displayed instead of 16. All other MG 
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parameters, such as Prime, Channel, and Theme are in 
effect. The user should review the MO status before 
setting up the reminder calendar schedule. Up to 16 
programs can be entered in the reminder calendar sched- 
3 ule listing using two pages of display. The page keys 232 
and 234 are used to access the second page. Either the 
up or down keys 232 and 234 will toggle the reminder 
calendar schedule listing. 
A typical reminder calendar schedule is shown below: 

10 

Column 16, lines 5-14: 

The cursor and pages keys 232-238 operation is iden- 
tical to the MO mode except the range is restricted to 
either the upper or lower half of the display. If the 

15 cursor points to the top of the program listing (line 9), 
the listing will scroll down a half page (eight lines). If 
the cursor points to the bottom of the reminder calendar 
schedule (line 8), the reminder calendar schedule will 
shift to the next page. To cross from reminder calendar 

20 schedule to program list, and vice versa, the P key is 
used. The cursor will reposition itself to the top of the 
new selection. 

Column 16, lines 18-27: 

To add a program to the reminder calendar schedule, 
use the P key 24$ to toggle the cursor to the program 
listing (lower half of display). Use the cursor, page, or 
+ keys 232-234, 236-238 or 244 to locate the desired 
program. Use the SEL key 228 to store the program in 
the reminder calendar schedule. The upper screen will 
immediately display the new addition. If the page is full, 
the Program Master will automatically switch to the 
next page. If both pages are full, the status line will 
35 show a FULL message. 

Column 17, lines 38-49: 

A search of the program listing 352, stored in program 
list buffer 303, is made. The search is dependent on the 

40 status of the channel buffer, the theme buffer, the prime 
time buffer, and the direction of search. If the page 356 
is up, the search direction is forward starting from the 
list pointer. If the page is down 357, the search direction 
will be backward 358 from the current list pointer. 

45 When the search satisfies the above criteria, the pro- 
gram listing from program list buffer 303 is placed into 
the screen buffer 353. The search continues until the 
screen buffer is full 354 in which case the search is 
terminated. The status lines information is passed to the 

SO screen buffer and displayed 355 by the TV. Program list 
buffer 303, screen buffer 353, and the other buffers dis- 
cussed above comprise a data storage means, 

AS A RESULT OF REEXAMINATION, IT HAS 
55 BEEN DETERMINED THAT: 

The patentability of claims 13, 16, 17, 32, 35, and 53 is 
confirmed. 

60 Claim 8 is cancelled. 

Claims 1, 4, 12, 14, 15, 18, 21, 29, 33, 34, 36-39, 42, 51, 
52 and 54 are determined to be patentable as amended. 

65 Claims 2, 3, 5-7, 9-11, 19, 20, 22-28, 30, 31, 40, 41, 
43-50, 55, and 56, dependent on an amended claim, are 
determined to be patentable. 
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New claims 57-67 are added and determined to be the schedule information, said data processor being 
patentable. configured to [allow combinations of] combine the 

menu selections for choosing programs from the scbed- 
1. A system for controlling a television receiver to ule information, wherein said menu selections comprise a 
allow user selection of broadcast programs from sched- 5 plurality of user program selection criteria, said data pro- 
ule information stored in a storage means, which com- cesser being configured to combing said plurality of user 
prises a data processor, a first input means for the sched- program selection criteria and to present a list of programs 
ule information connected to said data processor, a meeting said combined selection criteria, said menu se- 
second user selection input means connected to said lected further comprising a program choice from said pres- 
data processor, said data processor being configured to 10 ented list of programs, said remainder calendar list com- 
select programs from the schedule information stored in prising information identifying titles for said programs 
said storage means based on user inputs, said storage selected by said data processor, said data processor being 
means being connected to receiver a reminder calendar configured to present the reminder calendar list including 
list comprising the schedule information for programs program titles and to allow user selection therefrom. 
selected by said data processor, and a programmable 15 14. A system for controlling a television receiver to 
tuner for connection to the television receiver, said allow user selection of broadcast programs from sched- 
programmable tuner being connected to receiver con- ule information stored in a storage means, which com* 
trol signals from said data processor at a time of a se- prises a data processor, a first input means for the sched- 
lected broadcast for causing said programmable tuner ule information connected to said data processor, a 
to supply broadcast signals for the selected program to 20 second user selection input means connected to said 
the television receiver, said data processor being config- data processor, said data processor being configured to 
ured to supply an actuating signal to a program recoder select programs from the schedule information stored in 
at the time of a broadcast program selected by said data said storage means based on user inputs, said storage 
processor and to supply the broadcast signal for the means being connected to receive a reminder calendar 
selected program to said program recorder, said system 25 list comprising the schedule information for programs 
being configured to allow said television receiver to selected by said data processor, and a programmable 
receive a different program than the broadcast signal tuner for connection to the television receiver, said 
for the selected program supplied to said program re- programmable tuner being connected to receive control 
corder, wherein said user inputs comprise a plurality of signals from said data processor at a time of a selected 
user program selection criteria in addition to any time- 30 broadcast for causing said programmable tuner to sup- 
period programs selection criteria, said data processor ply broadcast signals for the selected programs to the 
being configured to combine said plurality of program television receiver, said data processor being config- 
selection criteria and to present a list of programs meeting ured to supply an actuating signal to a program re- 
said combined program selection criteria, said user inputs corder at the time of a broadcast program selected by 
further comprising a program choice from said presented 35 said data processor, said data processor being connected 
list of program, said reminder calendar list comprising to a remote controller for said program recorder to 
information identifying titles for said programs selected by supply control signals to said remote controller for 
said data processor, recording of the selected program, wherein said user 

4. The system of claim 2 in which said date processor inputs comprise a plurality of independent user program 
and said video display generator are further configured 40 selection criteria, said data processor being configured to 
to present a preselected portion of the schedule infer- combine said plurality of user program selection criteria 
mation for the user selection, wherein said preselected and to present a list of programs meeting said combined 
portion is preselected by said data processor according to at program selection criteria, said user inputs further compris* 
least one of a current time and a current channel of said ing a program choice from said presented list of programs, 
programmable tuner, 45 said reminder calendar list comprising information identi- 

12. A system for controlling a television receiver to fifing titles for said programs selected by said data proees- 
allow user selection of broadcast programs from sched- son 

ule information stored in a storage means, which com- 15. A system for controlling a television receiver to 
prises a data processor, a first input means for the sched- allow user selection of broadcast programs from sched- 
ule information connected to said data processor, a 50 ule information stored in a storage means, which corn- 
second user selection input means connected to said prises a data processor, a first input means for the sched- 
data processor, said data processor being configured to ule information connected to said data processor, a 
select programs from the schedule information stored in second user selection input means connected to said 
said storage means based on user inputs, said storage data processor, said data processor being configured to 
means being connected to receive a reminder calendar 55 select programs from the schedule information stored in 
list comprising the schedule information for programs said storage means based on user inputs, said storage 
selected by said data processor, and a programmable means being connected to receive a reminder calendar 
tuner for connection to the television receiver, said list comprising the schedule information for programs 
programmable tuner being connected to receive control selected by said data processor, and a programmable 
signals from said data processor at a time of a selected 60 tuner for connection to the television receiver, said 
broadcast for causing said programmable tuner to sup- programmable tuner being connected to receive control 
ply broadcast signals for the selected programs to the signals from said data processor at a time of a selected 
television receiver, said data processor being config- broadcast for causing said programmable tuner to sup- 
ured to provide signals to [said] a video display gener- ply broadcast signals for the selected programs to the 
ator for presenting a plurality of user selection menus on 65 television receiver, said data processor being config- 
the television receiver, and said second user selection ured to supply an actuating signal to a program re- 
input means includes a plurality of keys for making corder at the time of a broadcast program selected by 
selections from the menus for choosing programs from said data processor and to supply the broadcast signal 
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for the selected program to said program recorder, the program choice, the data processor combining said user 

broadcast signals including end of program information selection criteria, using the combined user selection crite- 

for at least programs of uncertain duration, and said ria to select programs for viewing from the program 

data processor being configured to terminate recording schedule information in said storage means in the data 

by the pr o gram recorder in response to the end of pro- 5 processor, storing information identifying the selected 

gram information, wherein said user inputs comprise a programs including broadcast schedule times, channels, 

plurality of user program selection criteria including chan- and program titles, using the stored information to tune 

nel and program theme criteria, said data processor being the television receiver to the selected programs, turning 

configured to combine said plurality of user program selec- on a broadcast program recording device for a selected 

tion criteria and to present a list of programs meeting said 10 broadcast program, recording the selected broadcast 

combined program selection criteria, said user inputs fur- program, broadcasting end of program information for 

ther comprising a program choice from said presented list at least programs of uncertain duration, and terminating 

of programs. recording by the program recording device in response 

. 18. A process for controlling the presentation of to the end of program information* 

broadcast programs to a television receiver, which IS 36. A process for controlling the presentation of 

comprises supplying program schedule information to broadcast programs to a television receiver, which 

storage means in a data processor, supplying user pro- comprises supplying program schedule information to 

gram selection criteria to the data processor, said user storage means in a data processor, supplying user pro- 

program selection criteria comprising a plurality ofinde* gram selection criteria to the data processor, said user 

pendent user chosen program selection criteria and at least 20 program selection criteria comprising a plurality ofinde* 

one program choice, the data processor combining said pendent user chosen selection criteria and at least one 

user selection criteria, selecting those programs meeting portion choice, the data processor combining said user 

the combined user selection criteria for viewing from selection criteria, using the combined user selection crite- 

the program schedule information in said storage means ria to select programs for viewing from the program 

in the data processor, storing information identifying 25 schedule information in said storage means in the data 

the selected programs, said stored information identifying processor, storing information identifying the selected 

broadcast schedule times, channels, and program titles, programs including broadcast schedule times, channels, 

and using the stored information to tune the television and program titles, using the stored information to tune 

receiver to the selected programs. the television receiver to the selected programs, turning 

21. The process of claim 19 in which only a prese- 30 on [the] a program recording device, and recording 

lected portion of the schedule information is presented the selected program by supplying control signals to a 

for the user selection, wherein said preselected portion is remote controller for the program recording device. 

preselected according to a combination of said independent 37. A process for controlling the presentation of 

user chosen program selection criteria. broadcast programs to a television receiver, which 

29. The process of claim 28 further including the 35 comprises supplying program schedule information to a 
steps of providing linking information to identify multi- data processor, wherein said program schedule Informa- 
nt programs of a single series and selecting the multiple tion includes linking information, supplying user pro- 
programs of the single series on the basis of the linking gram selection criteria to the data processor, using the 
information in response to user selection of one of the user selection criteria to select programs for viewing 
programs in the single series, wherein said program 40 from the program schedule information in the data 
schedule information provided to said storage means in* processor, storing information identifying the selected 
eludes said linking information. programs, using the stored information to tune the tele- 

33. A process for controlling the presentation of vision receiver to the selected programs, providing said 
broadcast programs to a television receiver, which linking information to identify multiple programs of a 
comprises supplying program schedule information to 45 single series and selecting the multiple programs of the 
storage means in a data processor, supplying user pro- single series on the basis of the linking information in 
gram selection criteria to the data processor, the data response to user selection of one of the programs in the 
processor combining said user selection criteria with auto- single series. 

matic criteria according to at least one of a current time 38. A process for controlling the presentation of 

period and a current channel, using the combination of 50 broadcast programs to a television receiver, which 

user selection criteria and automatic criteria to select comprises supplying program schedule information to 

programs for viewing from the program schedule infor- storage means in a data processor, supplying user pro- 

tnation in said storage means in the data processor, stor- gram selection criteria to the data processor, said pro* 

ing information identifying the selected programs, using gram selection criteria comprising a plurality ofindepen- 

the stored information to tune the television receiver to 55 dent user chosen selection criteria and at least one program 

the selected programs, turning on a broadcast program choice, the data processor combining said user selection 

recording device for a selected broadcast program, criteria, using the combined user selection criteria to 

recording the selected broadcast program, and supply- select programs for viewing from the program schedule 

ing a different program broadcast signal to the televi- information in said storage means in the data processor, 

skm receiver than the broadcast signal for the selected 60 storing information identifying the selected programs 

program supplied to the program recording device. including broadcast schedule times, channels, and pro- 

34. A process for controlling the presentation of gram titles, using the stored information to tune the 
broadcast programs to a television receiver, which television receiver to the selected programs, determin- 
comprises supplying program schedule information to ing whether the television receiver is operating prior to 
storage means in a data processor, supplying user pro- 65 the time of a broadcast program selected by the process 
gram selection criteria to the data processor, said user and providing an alarm signal to the user unless the 
program selection criteria comprising a plurality of inde- television receiver is operating when the television 
pendent user chosen selection criteria and at least one receiver is checked for operation. 
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39. A system for controlling a television receiver to 51. A system for controlling a recording device to 
allow user selection of broadcast programs from sched- allow user selection of broadcast programs from sched- 
ule information stored in a storage means, which com- ule information, which comprises a data processor, a 
prises a data processor, a first input means for the sched- first input means for the schedule information con- 
ule information connected to said data processor, a 5 nected to said data processor, a second user selection 
second user selection input means connected to said input means connected to said data processor, said data 
data processor! said data processor being configured to processor being configured to select programs from the 
select programs from the schedule information based on schedule information based on user inputs, storage 
user inputs, said storage means being connected to re- means connected to receive the schedule information 
ceive the schedule information for programs selected by 10 for programs selected by said data processor, a pro- 
said data processor, and a programmable tuner for con- grammable tuner for connection to the recording de- 
section to the television receiver, said programmable said programmable tuner being connected to re- 
tuner being connected to receive control signals from ceive control signals from said data processor at a time 
said data processor at a time of a selected broadcast for of a selected broadcast for causing said programmable 
causing said programmable tuner to supply broadcast 13 to ro PP lv broadcast signals for the selected pro- 
signals for the selected programs to the television re- to recording device, said data processor 
ceiver, a video display generator connected to receive ^8 connected to a remote controller for said record- 
signals from said data processor for generating a com- m * dev,cc to ^PP^ co,ItI10, signals to said remote con- 
bined video display from the schedule information and troDcr for P° wcrm S on recording device, starting 
the user selections on the television receiver, and a 20 "* *?W*$ recording of the selected program and 
video switcher connected to receive video display sig- powering off said recording device, further comprising a 
nals from said video display generator, broadcast pro- d ^ la * means to^ui data pj^r wherein said 
gram signals from said programmable tuner and control da " * & [* 
signals from said data processor for selecting between „ T B ?L*f7 ft*™* t0 ^ la > " inUial 
the video display signals and the broadcast program 25 dtsphy * *"* ff* ^or^mn stored^ sad storagt 
signals for suppIyingTo the television received *™ * display mc^e, said mstial 
schedule mformation also being broadcast, said first display automaucally compnsing schedule information for 
input means comprising a broadcast signal receiver "J"? one of a current time period and a current channel 
connected to supply the broadcast schedule information 30 0/ £*/^7^ . «»din. j • to 
to said data processor, said data processor being config- 30 u A 8y8t f". for c ?" trol ! mg * ^^rag dcvic * *> 
_*7; jT^Zl i T 7 ^ r \ * allow user selection of broadcast programs from sched- 
ured to provide signals to said video display generator nU ^fx™^,^ ^ui, . . 

jorp^ 

television receiver, said second user selection input ncctcd t0 ^ ^ processor, a second user selection 
means mcludmg a plurahty of keys for making selec- 35 b t means connected to said data processor, said data 
tions from the menus for choosing programs from the p^^, ^ configured to select programs from the 
scheduk : information, said dau processor ^g config- Khedul e infonnation based on user mputs, storage 
ured to WlowcombmauonsoftheJ combine a plurality mcans coveted to receive the schedule information 
c/menu selections as selection cntena, including a plural- for pro grams selected by said data processor, a pro- 
ity of channel requirements, for choosing programs from 40 grammable tuner for connection to the recording de- 
the schedule ^formation, vice, said programmable tuner being connected to re- 

42. A system for controfling a recording devtce to ^ ye control signals from said data processor at a time 
allow user selection of broadcast programs from sched- of a Nected broadcast for causing said programmable 
ule information, which comprises a data processor, a tuner to supply broadcast signals for the selected pro- 
first input means for the schedule information con- 45 grams to the recording device, the broadcast signals 
nected to said data processor, a second user selection including end of program information for at least pro- 
input means connected to said data processor, said data grams of uncertain duration, and said data processor 
processor being configured to select programs from the being configured to terminate recording by the record- 
schedule information based on user inputs, storage fog device in response to the end of program informa- 
xpeans connected to receive the schedule information 50 tion, further comprising a display means coupled to said 
for programs selected by said data processor, a pro- data processor, wherein said data processor is configured 
grammable tuner for connection to the recording de- far a selectable display mode, said display means being 
vice, said programmable tuner being connected to re- configured to display an initial display of said schedule 
ceive control signals from said data processor at a time information stored in said storage means upon selection of 
of a selected broadcast for causing said programmable 55 said display mode, said initial display automatically com- 
tuner to supply broadcast signals for the selected pro- prising schedule information for at least one of a current 
grams to the recording device, and a television receiver, time period and a current channel of said programmable 
said system being configured to allow said television tuner. 

receiver to receive a different program than the broad- 54. A system for controlling receipt of broadcast 
cast signal for the selected program supplied to said 60 television programs to allow user selection of broadcast 
recording device, wherein said data processor is config- programs from broadcast schedule infonnation which is 
ured for a selectable display mode, said data processor selectively stored in a storage means, which comprises a 
being configured to present an initial display of said sched' data processor, a programmable tuner configured to 
ule information stored in said storage means upon selection receive both the broadcast programs and the broadcast 
of said display mode, said initial display automatically 65 schedule information connected to said data processor, 
comprising schedule information for at least one of a cur- means connected between said programmable tuner and 
rent time period and a current channel of said programma- said data processor for separating the broadcast sched- 
ble tuner. ule information from the broadcast programs and sup- 



Bl 4,706,121 

9 10 

plying the broadcast schedule information to said data a preselected initial display of said schedule informa- 

processor, a user selection input means connected to tion stored in said storage means upon selection of said 

said data processor, said data processor being config- display mode, said preselected initial display automat- 

ured to select programs from the schedule information ically comprising schedule information meeting initial 

stored in said storage means based on user inputs, said 5 display selection criteria, said initial display selection 

storage means being connected to receive a reminder criteria including at least one of a current time period 

calendar list comprising the schedule information for and a channel currently selected by said progromma- 

programs selected by said data processor, said program- ble tuner. 

mable tuner being connected to receive control signals 5b\ The system of claim 57, wherein said data processor 

from saM data processor at a time of a selected broad- 10 is configured to update said program listings of broadcast 

cast for causing said programmable tuner to supply schedule information and said stored schedule information 

signals for the selected broadcast programs to at least for selected programs, in response to updated schedule 

one signal receiver for the selected broadcast programs, information being supplied to said data processor, 

wherein said user inputs comprise a plurality of user pro- 59. The television schedule system of claim 57, wherein 

gram selection criteria, said data processor being config- 15 said stored broadcast schedule information identifies a 

ured to combine said plurality of user program selection program description for each said selected program, 

criteria and to present a list of programs meeting said 60 The television schedule system of claim 57, wherein 

combined program selection criteria, said user inputs fur- said preselected initial display automatically comprises 

ther comprising a program choice from said presented list schedule information for a channel currently selected by 

of programs, said reminder calendar list comprising infor- 20 said programmable tuner, and wherein said display means 

motion identifying titles for said programs selected by said further comprises means for displaying on said television, 

data processor. upon a change to a new channel of said programmable 

57. A television schedule system for controlling receipt of tuner, broadcast schedule information for a current pro* 

broadcast television programs to allow user selection of gram on said new channel 

broadcast programs from broadcast schedule information 25 61. The television schedule system of claim 60, wherein 

displayed on a television, said broadcast schedule informa- said displayed current program broadcast schedule infor- 

tion comprising broadcast schedule times, titles and chan- motion comprises a title of said current program, 

nels, said system comprising: 62. The television schedule system of claim 60, wherein 

a data processor; said displayed current program broadcast schedule infor- 

a system clock connected to said data processor for pro- 30 motion comprises a remaining time of said current pro- 
viding a system time; gram. 

a programmable tuner connected to said data processor 63. The television schedule system of claim 57, wherein 

and configured to receive both the broadcast programs said user selection input means provides user selection 

and the broadcast schedule information; criteria, the data processor being configured to combine a 

signal separating means connected between said pro- 35 plurality of said user selection criteria with at least one 

grammable tuner and said data processor for separat- selection criterion chosen automatically by said data pro- 

ing the broadcast schedule information from the cessor according to at least one of a current time and a 

broadcast programs, and for supplying the broadcast channel currently selected by said programmable tuner, 

schedule information to said data processor; said preselected initial display being of schedule informa- 

display means connected to said data processor for dis- AO tion meeting said combined selection criteria, 

playing at least a portion of said broadcast schedule 64. A system for controlling receipt of broadcast televi- 

information on said television; sion programs to allow user selection of broadcast programs 

user selection input means connected to said data proces- from broadcast schedule information which is selectively 

sor for providing user inputs for selecting listings of stored in a storage means, which comprises a data proces- 

programs from said displayed broadcast schedule 45 sor, a programmable tuner congfigured to receive both the 

information; and broadcast programs and the broadcast schedule informa- 

storage means being connected to said data processor for tion connected to said data processor, means connected 
storing schedule information, wherein said data pro- between said programmable tuner and said data processor 
cessor is configured to select programs from said dis- for separating the broadcast schedule information from the 
played broadcast schedule information based on said 50 broadcast programs and supplying the braodcast schedule 
user inputs, to retrieve broadcast schedule information information to said data processor, a user selection input 
for said selected programs from said broadcast sched- means connected to said data processor, said data processor 
ule information supplied to said data processor, and to being configured to select programs from the schedule 
store said retrieved schedule information in said stor- information stored in said storage means based on user 
age means, said stored broadcast schedule informa- 55 inputs, said storage means being connected to receive a 
tion identifying a broadcast schedule time and chan- reminder calendar list comprising the schedule informa- 
nt and a program title for each said selected pro- tion for programs selected by said data processor, said 
. gram; wherein programmable tuner being connected to receive control 

said data processor provides control signals to said pro- signals from said data processor at a time of a selected 

grammable tuner when the system time matches a 60 broadcast for causing said programmable tuner to supply 

stored broadcast schedule time of one of said selected signals for the selected broadcast programs to at least one 

programs, said control signals causing said program- signal receiver for the selected broadcast programs, wherein 

mable tuner to supply broadcast program signals for said user inputs comprise a plurality of user program selec- 

the stored broadcast schedule channel of said one tion criteria including a plurality of channels, said data 

selected program to at least one signal receiver; and 65 processor being configured to combine said plurality of user 

wherein program selection criteria and to present a list of programs 

said data processor is configured for a selectable display meeting said combined program selection criteria, said user 

mode, said display means being configured to display inputs further comprising a program choice from said 
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presented list of programs, said remainder calendar list said displayed list of programs, said reminder calendar list 
comprising information identifying titles for said programs comprising information identifying titles for said programs 

selected by said data processor. selected by said data processor. 

63. A system fir controlling recent of broadcast televt- 66. a process fir controlling the presentation of broad- 
sion programs to allow user selection of broadcast programs 5 cast programs to a television receiver, which comprises 
from broadcast schedule information which is selectively supplying program schedule information to a storage 
stored in a storage means, which comprises a data proces- means in a data processor, supplying user program selec- 
tor, a programmable tuner configured to receive both the ^ criteria to the data processor, said user program selec- 
broadcast programs and the broadcast schedule informa- ^ ^tena comprising a plurality of independent user 
tion connected to said data processor, means connected 10 choseH progntm crUe ria and at least one program 
between said programmable tuner and said data processor choktf ghe da%Q Fvcmr ^ „ Iec tion 
fir separating the broadest schedule informatwn from ^ ^ ^ ^ muti jhe 
broadcast programs and supplying the broadcast schedule ^ selection criteria fir viewing from the program sched- 
information to said data processor, a user selection input uh information m J d storag€ ^ m f^ata proces. 

*7n?ZZ^ W°™**>n uie7ifying the selected proUms. 
betng configured to select programs from the schedule ^ . ^ ^ information to tune the television 
information stored in said storage means based on user . *T 
inputs, said storage means being connected to receive a recnnr ta the seated proems, 
reminder calendar list comprising the schedule informa- 61 A P roc ^f OT controlling the presentation of broad- 
tion for programs selected by said data processor, said 20 cfl,r Programs to a television receiver, which comprises 
programmable tuner being connected to receive control **PPW*Z program schedule information to a storage 
signals from said data processor at a time of a selected means m 0 ^processor, supplying user program seleo 
broadcast for causing said programmable tuner to supply criteria t0 the Pressor, the data processor corn- 
signals for the selected broadcast programs to at least one fining said user selection criteria, selecting those programs 
signal receiverfor the selected broadcast programs, wherein 25 me * tin * th * combined user selection criteria for viewing 
said user inputs comprise a plurality of user program selec- f™ m tne program schedule information in said storage 
tion criteria under a plurality of categories, said categories means in the data processor, storing information identffy- 
capable of being activated or deactivated, said user pro- i*$ selected programs, and using the stored information 
gram selection criteria being stored for both activated and to tune the television receiver to the selected programs, 
deactivated categories, said data processor being config- 30 wherein a group of said selection criteria are combined by 
ured to combine said user program selection criteria for all the data processor as logical alternatives so that the combi- 
currently activated categories and to present a list of pro- nation of said group of selection criteria is satisfied when- 
grams meeting said combined program selection criteria, ever any one of said selection criteria of said group is met 
said user inputs further comprising a program choice from • * * * • 
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ABSTRACT 



Help is provided to the user of a data processing system 
having a work station, including a display, and input 
means including a visible on-screen indicator and a 
selection means, in response to a request from the user, 
information on the current state of the system is used to 
address a store of hierarchical help text information, 
thereby providing contextual help text which is dis- 
played in a separate window on the display screen 
alongside information related to the task in hand. A help 
map function is available which displays concurrently, 
separately from the help text, a portion of a hierarchical 
map of the stored help text to be replaced by new help 
text corresponding to the selected map entry. 

21 Claims, 7 Drawing Sheets 
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items on the screen by means of a visible on-screen 
HELP PROVISION I N A D ATA PROCESSING indicator, selection means for communicating a selec- 
SYSTEM tion to the system on the basis of displayed information 

and help request means for requesting help information 
This application is a continuation of U.S. application 5 from the system; the system further including an ad- 
No. 07/469 t 549 filed Mar. 20, 1990, now U.S. Pat. No. dressable store of hierarchical help text information, 
5,122,972. contextual help means responsive to an appropriate 

TECHNICAL FIELD OF THE INVENTION re<njest for heI P and 10 currcnt mXe of *** Xtm 

^ . when help was requested to access the help text store to 

The invention relates to data processing systems and 10 obtain appropriate help text and to cause the display 

to a method of providing help to a user of such a system, manager to display said help text through a help text 

BACKGROUND OF THE INVENTION window on said screen, concurrently with the informa* 

. . . . , tion related to the task or tasks in hand which was being 

It is common practice for programmed data process 0 i S pia ycd whcn help was requested, help map display 

uig systems to provide help to an operator or user in 15 mean8 responsive to selection by said selection means to 

response to a request for help. Such help is displayed to ^ the dj , m t0 dis j m a ^ ^ 

he operator at a workstation and frequently replaces d0 w, concurrently with said help text window, at least 

If £uXZ ff'LT 6 " 6 7 y ' P my - T""* * Portion of a hierarchical map of the stored help text, 

of actual help information or of a menu or index of -Tltw rt r „ ( u; 0 u *L +rt „ . . _j . , ' 

possible help from which the operator is required to 20 M ^ en ^ ofwrachTOr ^P°nds toa umt of stored help 

Sect an item. Such indice Tc^ bTve£ eVSe and mca f T " ^Ti™ °1*™ P "3 

laborious to search in themselves. * y ^f^J*™ *• ^ ^ f?"^"?' 

So called contextual help is known in which the help ^ ° P 
provided is not merely general to the current screen or texwinaow . .« A , , r 
application but is specific to the actual position of a 25 . ™ e mventl ° n *° P rovide ? a method of providing 
cursor or pointer onto screen. Three related articles hd P 10 8 "J* * B d ^ oroces f>S system havmg a work 
describing a contextual help system by R E Berry, S E st f°" mcIud,n « 8 d,s P lav ■»* m P ut means b V 
Johnson et al. are found in the IBM Technical Disclo- whlch ™ °P e ? Uor communicate with the system 
sure Bulletin (Vol 27, No. 10B, March 1985 at pages mteractively, the mput means mcludmg indicator means 
6126, 6127 and 6128). These articles show the provision 30 for ldentlf y m 8 <> n tl >e screen by means of a visible 
of contextual help in windows on a display screen. Two on-screen indicator, selection means for communicating 
types of Help panel are possible, Active and Passive. 8 Section to the system on the basis of displayed infor- 
The Active panel allows the operator to make further nwtion and help request means for requesting help in- 
unspecified selections from within the panel. However, formation from the system; the system further including 
no other provision for knowing what alternative help is 35 80 addressable store of hierarchial help text inforraa- 
available is made. * tion; the method comprising the steps of accessing the 

Another contextual help system making use of win- ncl P tcxt store in response to a request for help and to 

dowing capabilities is described in European patent the current state of the system to obtain appropriate 

application 0185845 A2, entitled "Help placement on a help text, displaying said help text concurrently with 

screen for a computer user". Help messages are dis- 40 t° c information related to the task or tasks in hand, 

played in a window which is so positioned in areas of responding to selection of help map function by the user 

the screen as to minimise the overlapping or obscuring to display, separately from the help text but cocurrently 

of the screen content. therewith, at least a portion of a hierachical map of the 

Also known in the provision of help to a computer stored help text each entry of which corresponds to a 

user is the concept of multi-level help in which, if the 45 unit of stored help text and responding to a further 

initially displayed information (first level help) is made- selection by the user of an entry on the help map to 

quate, the user may request further more detailed infor- display new help text replacing that originally dis- 

mation (second level help). Examples of systems em- played. 

ploying multiple levels of help can be found in an article By providing a help map concurrently with the help 

by D Koeller et al in the IBM Technical Disclosure 50 text and application, the user is enabled, without losing 

Bulletin entitled "Improved method for Help Lookups" track of the circumstances in which he first requested 

(Vol 29, No. 1 June 1986, P 291) and in European pub- help, to consider and select alternative related help text 

lished patent application 0190419 A2 entitled "Method at the same level which may be more appropriate to his 

for providing an on-line help facility for interactive needs. This does not exclude the known provision of 

information handling systems", 55 help at different levels, in addition, such as, for example, 

„ ^rr^r^^, a lower tutorial level of help. 

DISCLOSURE OF THE INVENTION Although selection could be made purely on the basis 

The above mentioned prior art thus fails to provide of a typed response to messages, it is preferable that the 

easy location of alternative or related help at the same selection means is associated with the visible indicator 

level as the contextual help initially provided. 60 so that the displayed item indicated by the indicator is 

Accordingly, the present invention provides a data selectable by operation of the selection means, This 

processing system having a work station including a could involve selection of an item indicated by a cursor 

display for displaying on a screen panels of information by operation of an entry key as a keyboard or could be 

relating to one or more tasks, the panels being viewable effected with a light pen. However, the preferred imple- 

through windows under the control of a display man- 65 mentation is a so called "mouse" device in which move- 

ager, and operator input means by which an operator ment of a pointer on the display is caused by movement 

can communicate with the system interactively, the of the mouse. Depression of a selection button on the 

input means including indicator means for identifying mouse selects the item indicated by the pointer. 
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In order for the contextual help means to access the mechanism for the user to move around the map. This 

help text store, it is preferred that the current state of operates so that branching may be selected on given 

the system be defined by a plurality of system state map entries to cause display of a new help map. Where 

variables which the help means uses as addressing infor- the given entry was originally one of the lower order 

mation. It is also preferred, that the system variables are 5 entries, it becomes the higher order entry on the new 

ranked in an order corresponding to different orders of map. Where the given entry was originally the higher 

help text in the help text store. Thus, a system state order entry, it becomes one of the lower order entries 

defined by system variables including low order van- 0 n the new map. 

ables would result in a correspondingly low order (i.e To assist branching, the map entries preferably in- 
more specific) help text whereas a system state defined 10 c ] U( j e icons, for example arrows, to indicate the permit* 
only by high order variables would result in a corre- ted direction of branching. Where no further branching 
spondingly high order (i.e. more general) help text. & possible from an entry, no icon is provided. The 

It should be noted, at this point, that the reference to branching operation can be selected by any of the van- 

help text of different order relates to the generality or ous selection techniques discussed above, the easiest 

specificity of the text and not to the provision of differ- 1 5 use 0 f mouse and pointer, 

ent help function at different levels of operation. Although the map offers a convenient method of 

Although, in theory, the system variables could be navigation around the help text, it need not be the only 

used directly to address a help text store, it is preferred method by which alternative text may be obtained. In a 

that the help text store is addressed by a key which is prc f crred version of the system, a unit of help text can 

obtained from a key table to which the system variables 20 mdude selectable branch words withing the body of the 

are applied. The key can thus be an address actually m which m associated witn related units of help text, 

used by the system memory whereas the system van- Branching to the related units of text occurs in response 

ables are essentially user or system function onented. It tQ x]cction ofa selectable word by the indicator/selec- 

will be realised that each system state, as defined by the tion means ^mm^ The result of the branching 

system variables, does not necessarily correspond to a 25 ^ {$ ^ ^ di j ^ kces ^ ori ^_ 

unique unit of help text. Some system states may share £ m ^ M ^[^^ ^ the related text, 

common help text so that addressing the key table will As g y ^ m Qn ^ ab0VCj a gIossary store 

produce the same key. may also be provided so that, upon selection of a word 

the provision of contextual help, is that the low order 30 * alphabetically nearest word 

system vanables relate to the position of the indicator , " , , r j. , K , . J . „ _ 

on the screen. Thus the corresponding low order help » «J store 15 *W* m a * Iossary 

££££ t0 ^ itCm ° r ^ idCndfied ^ ^Invention wUl now be described in more detail, 

A convenient preferred version of this is that at least 35 * ™ v of example only with reference to a preferred 

three orders of system variable are used corresponding embodiment thereof as illustrated in the accompanying 

to the application being executed, the current panel on drawings. 

the display screen which is owned by the application BRIEF DESCRIPTION OF THE DRAWINGS 

and any predefined box located within the panel. There . , r * , _ 

are three corresponding orders of help text in the help 40 FIG. 1 » a block diagram of the major hardware 

store from high to low respectively. components of a data processing system according to 

It is also possible in some systems to have a fourth th *^yf nt j on i , . „ , , , .,<_». 

higher order of help corresponding to a system facility FIG. 2 illustrates schematically the help available in 

which owns the application. the preferred embodiment of a data processing system 

Turning now to the help map itself, although it is 45 according to the invention; 

possible for a static map to be stored by the system, FIG. 3 illustrates the format of a Master window 

there are advantages in generating the map dynamically produced on the display in the preferred embodiment of 

from the help text store. One of these advantages is that a data processing system according to the invention; 

users can add to or modify the stored help text which FIG. 4 illustrates a display screen layout produced in 

will immediately be reflected in the map next time it is 50 the preferred embodiment at the point of selection of a 

created. View/Change application; 

Clearly either a static or dynamic map may be too FIG. 5 shows a display screen resulting from the 

large to be viewed through the available window. It has running of the View/Change application of FIG. 4; 

been found preferable, where possible within the hierar- FIGS. 6-8 shows successive display screens which 

cby, to select for display the map entries of the same 55 are produced in the preferred embodiment as a result of 

order as the current system variables which share com- employing certain of the help provision illustrated in 

mon higher order system variables and also to display FIG. 2; 

the higher order entry represented by the common FIG, 9 shows portions of a Help Index Table and 

higher order variables. Help Text Store employed in the preferred embodiment 

If by any chance, the map entry corresponding the 60 of the invention; and 

current system variables is not visible immediately FIG. 10 illustrates schematically the creation of Help 

within the help map window, the window can be Map in the preferred embodiment of the invention, 

scrolled or panned conventionally to reveal the remain- CARRYING OUT THE 

ing entries sharing the same higher order entry until the INVENTION 
required entry is found. 65 

Although scrolling and panning could be employed A data processing system according to the invention 

to reveal other areas of the map, it is preferable to pro* comprises both hardware and software. The hardware 

vide a more systematic selectively operable branching of the system is illustrated in FIG. 1 and is conventional. 
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A microprocessor 10 communicates with a fixed off the screen. Error and warning messages plus help 
memory 11 and with peripheral devices. These included information appear through Pop-up windows 
fixed disk storage 12 and floppy disk storage 13 by way The physical screen is referred to as the 'desk top 1 and 
of which programs can be loaded to cause the system to always contains a Master window giving access to all 
execute data processing tasks. The results of there data 5 system function. The Master window occupies minimal 
processing tasks arc displayed to an operator or user, by screen space, containing a Prompt Area, Command 
way of a graphics adapter 14, on a colour display 15. Line and an Application Action Bar (AAB), consisting 

Input to the system by the operator may be from of a number of choices. Its format is as shown if FIG. 3 
keyboard 16 which has a normal range of keys, includ- The Application Action Bar choices may be selected 
ing an entry key 17 which may be used to indicate selec- 10 using keyboard 16 or mouse 19. On selection they pres- 
tion, and a help key 18 (labelled Fl) for requesting help ent Pull-down windows with the following services: 
from the system. As an alternative to requesting selec* Process: Initiation of saved specifications, programs 
tion and help from the keyboard, a mouse device 19 is and procedures; 

also provided. Movement of the mouse causes move- Facilities: Initiation of any enrolled application; 
mentofa pointer on the screen of display 15, The mouse 15 Data: Data Dictionary Management function are 
is provided with at least two distinct buttons, one of provided via a data window; 
which, 20, indicates selection of the item at which the Actions: Enable the user to perform various actions, 
pointer is pointing and the other of which, 21, is a re- set profile information and enroll new facilities and 
quest for help, whose function is exactly equivalent to applications; 

operation of the Fl key on the keyboard. 20 Desk Top: Manipulation of objects on the desk top; 

The software part of the data processing system con- Exit: Close down the system and any active applica- 
sists of normal operating software for controlling opera- tions: 

tion of the hardware and an application program which By way of example, and as illustrated in FIG. 4 the 
the user desires to run. „ facilities service is accessed via the Facilities AAB 

One example of suitable hardware and operating choice on the Master Window. Facilities include, 
system would be an IBM PS/2 computer (models 50, 60 among others, General, Reporting, Statistics and De- 
or 80) with an IBM OS/2 (Release 1.0) operating sys- velopment as shown in the puD-down window 30 in 
tern (IBM is a Registered Trademark and PS/2 and FIG. 4 which appears on the desk top when selected by 
OS/2 are Trademarks of International Business Ma- 3Q means of the mouse 17 and pointer, 
chines Corporation). Access to individual applications within these facili- 

Tbe application program which is part of the data ties is achieved by selection of the relevant facility. This 
processing system of FIGS. 1 and 2 is of the multi-task- gives a Pop-up window containing a selectable list of 
ing kind in which numerous tasks can run simulta- applications. In the example of FIG. 4 the General 
neously. It consists of general system functions and a set 35 Facility is selected and a pop-up window 31 lists the 
of basic applications that enable general data manipula- available applications. The pointer 32 is pointed at an 
tion and presentation to be performed. application called View/Change which will be used to 

The system functions include two primary compo- illustrate the help facilities of the system. Noteworthy in 
nents, the Display Manager and the Data Store Man- FIGS. 3 and 4 is any area 34, in the AAB designated 
ager. The latter manages all data used by the system 40 "Fl=Help". This is an alternative way of requesting 
which is held in Data Stores. A Data Store is single help and requires the use of the pointer to point at area 
level and contains various data values and attributes as 34 and the operation of the select button on mouse 19. 
Data Items. A data dictionary provides information Common Action Areas (CAA's) at the bottom of 
about the individual Data Items which are referenced windows 30 and 31 enable the cancellation of the cur- 
by symbolic names. 45 rent panel. CAA's, in some cases, may also contain an 

The Display Manager provides full display services "Fl=Help M box. 
in all points addressable mode. It is fully integrated with As well as the Master window on the Desk Top, 
the Data Store. every application has a Main window with an Applica- 

The display manager allows many logical screens tion Action Bar. An example in FIG. 5, shows a screen 
(panels) to be presented on the physical display 15, jo with the selected View-Change application in progress. 
These panels are presented through windows which In any application. Pull-down windows are presented 
may be a different size from the related panel. The below the AAB choice on selection. Secondary win- 
windows may be displayed with or without overlap, dows may be presented by the application for display- 
With the exception of data entry, any of these windows ing information supplementary to that in the Main win- 
may be directly employed even if they are partly hidden 55 dow. Pop-up windows may also be used to present very 
by another window. Data entry may only be performed short term dialogues adjacent to a box on a Main or 
on the top most window, which is identified by the Secondary Window. 

presence of a data entry cursor. The Display manager To assist with the description of the help function, a 
presents data from the DataStore; the application does more precise definition of the terms "Window", 
not write data to windows. All applications present €0 "Panel" and M Box" is desirable, 
their information within these windows using panels. Panels are virtual rectangular areas used to present 
The panel is the application's defined display layout information through the windows. Each panel consists 
which will be presented somewhere on the physical of a rectangular area with a background colour, and 
display through a window. optional foreground colour and pattern, and a set of 

The entire screen is available to display windows 65 boxes. Each panel is named, 
which are optimally placed by the display manager. All Boxes are used to present character data or graphic 
windows have borders and may overlay one another if objects within the panel. Each box is also rectangular 
necessary. The user may move 8 window, even partially and is named. 
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A window is a rectangular area through which panels and typical tasks. It does not cover every possible task, 

are displayed the window is placed suitably by the Dis- It may involve a two-way information flow; the user 

play manager unless the application specifies that the may be asked to answer question or do exercises, 

window be placed adjacent to a box in another window, The four components provided by the main Help 

During a session, users may reposition the windows if 5 program are Text 24, Help Map 26, Glossary 25 and 

desired. Tutorial 27. The first three can be concurrently dis- 

Each window is known by name to the application played on the same screen whereas a Tutorial can only 

and the window size limit is essentially that of the panel be concurrent with the Glossary, 

it is displaying. A window has an initial size given by The Help Text is provided in a main window 24 with 

the associated panel but this may be changed by the 10 AAB which is scrollable. It is invoked through initial 

application or 'Desk—Top' function. Windows are posi- support selection or via the Help Map 26, The Help 

tioned suitably on the desk top by the system. However, Text function also allows branching by selection of a 

the user may reposition a window. The cursor indicates selectable word to alternative Text If there is no alter- 

the active window (for data entry purposes). Addition- native Text, the program branches to the nearest Glos- 

ally, all windows have borders which clearly define the 15 sary entry. 

extent of the window. The top border contains a title. The Help Map is controlled by a sub-program in- 

Thc border may also contain arrows that can be se* vo ^ e( j through Help Map selection on the Help Text 

lected for scrolling. window AAB. It provides a window based graphical 

Turning now to FIG. 2, a system for providing a total ute structurc 28 showing related Help Text titles and 

support environment for the user is illustrated. All the 20 ^i^fon 0 f the related Text items 29, which appear in 

information necessary to use the system is available the window 26. The Help Map program allows scrolled 

online, with a few exceptions. Help is available at three move ment through the tree and branching up and down 

different levels and can be requested at any time during ^ ^ structure . 

a session. The Glossary is also controlled by a sub-program 

First level support is provided when the Help key W 25 mvoked tnroug h Glossary selection on the Help Text 

or 21 (Fl) is pressed once, A message 22 is displayed window or ^ TutoriaUt provides definitions given by 

within a pop-up window and relates to the area under xlectiag a keyword from the Help Text or Tutorial or 

the pointer. The help provided is associated with either . fa ^ desircd wonJ If there fa n0 for 

the box or panel at which the pointer is directed. This ' ^ ^ d ^ alphabetically nearest words in 

first level of support provides an instant clue for the 30 ^ G]ossar ^ m ^ , * 

user who is momentarily puzzled, or who requires very « also controlled by a sub-program in- 
little information to get on the right track, but will window. Tutorial text is 
probablybeofliule^ Jr^ed S a main window 27 with AAB which is 
standing of the application bey are using. First level F™» a ^ 

help is provided by *^PP hca V^ , 35 to^by selection to alternative Text and branching by 

LTeSr^ of the Help and Help 
£S 40 Map programs will now be explained in more detail 

^Sformatton displayed is dependent upon which se^ion of the View/Change appUcatioi i from the 

apptotionX^eV " L. and at what pomt^tnin that window 31 of FIG. 4, the user has retrieved the : table of 
apffcX Support is contextual. Selecting the 45 ?**° ™^ 

Fl=Help box dteplays overview information about the displayed in the application wmdow 50, beneath mas- 
application or facility* which owns the box. *r window 51. It «^umed *e the ^ ^ 

The Help window 24 provides the additional options change the column headed Salary to read Compen- 

of selecting access to a Glossary 25 for explanations of *"ion" but doe* not know the procedure for doing so. 

words or phrases, access to a hierarchical map 26 of the 50 Z%"^>T« Z^I^LfI 

second level help text, and access to a third level of P™ 52 at the word "Salary and, by 

support the tutorial 27 kcv twicc ' 8 ct contextual help on column 

Second level support is extremely flexible. The user headings, shown in FIG. 8 * *f '^"^^ ™£ 

who understands ^concepts and purpose of an appli- might well press Fl help with thejwmteron the win- 
cation, and who invokes support for clarification of a 55 dow border or in a blank area. Pressing Fl once, dis- 

specific point, is likely to get exactly the information he plays a Help message wmdow containing the message 

needs. The user requiring more detailed or general in- "Select a View or Data Items to display the selected 

formation than that provided can use the map browsing data". As this clearly does not provide the nght sort of 

facilities to move up or down a hierarchical level of help, the user presses Fl again. This causes the View/- 
information. The user who is out of his depth can access 60 Change application to set the system variables defining 

the tutorial level of support to discover the concepts the current state of the application and to call the Help 

behind application, and get an overview of its function program. The system variables define the Facility , Ap- 

and the tasks it supports, Selection of third level support plication, Panel and Box. In the example, the first three 

is by selection of a 'Tutorial" box in the help window are set to "General", "View/Change" and "View/- 
24 65 Change" and null values are entered in the box. The 

Third level support is intended for first-time users of name of the first panel in an application is always the 

either the system or a particular application. A tutorial same as that of the application, i.e "View/Change", 

is explanatory in intent. It covers principles, facilities though the system variable is a panel variable. 
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The Help program opens various panels of its own, 
including the main Help window corresponding to 24 
(FIG. 2) and interrogates the system variables to deter- 
mine the subject on which help is required. A title for 
the Help window is created. A Help Index table 90 is 
then interrogated, as illustrated in FIG. 9, to extract a 
key value 91 corresponding to the system variables. 
This key is used to interrogate a Help Text table 92 to 
extract corresponding Help Text 93 for display in the 
Help Window. 

In the example, the text displayed is shown in Help 
window 60 in FIG. 6. This provides panel level help for 
the View/Change panel (which may be different from 
application level help). This still does not give the re- 



10 



The Help Map. program then displays the lower level 
Help Map portion shown in window 80 of FIG. 8. At 
this point the displayed help text in window is un- 
changed from that in window 60 in FIGS. 6 and 7. 
5 The new help map in window 80 contains the View/* 
Change panel entry 81 as parent, though this time with 
an upward branch arrow. The child entries relate to 
boxes within the View/Change panel and include an 
entry 82 entitled "Column Heading" Selection of entry 
10 82 by pointer 83 causes the system variables to be reset 
to reflect those for the "Column Heading" box and the 
replacement of the Help Text in window 84 by new text 
relating to Column headings. The user now has enough 
information presented in the Help Text main window to 



quired information but is getting close to the subject of IS enable him to make the change to the column heading 



interest. 

The user may then access the Help Map to find out 
what other help is available in this area. This is done by 
pointing the pointer at the word "Reference" in the 
AAB of window 60 which produces a small pull-down 20 
window 61 listing the two reference functions Help 
Map and Glossary. Pointing the Help Map entry and 
selecting it causes the display of a Help Map similar to 
that shown at 70 in FIG. 7. 

Selection of Help Map causes a Help Map program to 25 
generate the help map by creating current lists of all 
Facilities, Application, Panels and Boxes. These are 
arranged in a tree structure as shown schematically in 
FIG. 10 in which higher order (or parent) entry has 



"Salary" in the main application window 85. 

It will be noted that the application window does not 
disappear when the Help Text and Help Map windows 
are opened, so that the user is unlikely to forget the 
problem which caused him to request help and can 
initiate the action directly. 

It may also have been noted that there is an 
"Fl=Help" area in the Help Text windows, 60 and 84, 
themselves. This is selectable by means of the pointer to 
produce help relating to the use of the Help function 
rather than on the subject of the text. 

Help at levels above box level (i.e. panel level) may 
be selected by pointing and selecting blank areas and 
borders of the application window or the "Fl=Help" 



associated with it a number of lower order (or child) 30 •area of its AAB. Help at the Application or Facility 



entries. The parent entry corresponding to the current 
system variables is determined and placed in the Help 
Map panel along with all child entries which share that 
parent The lowest specified (i.e non-null) system vari- 
able is one of the child entries. Dynamic creation of the 35 
Help Map, as opposed to storing it statically, permits 
modifications and additions to the map to be made. 
It may not always be possible to display all child 

entries in the Help Map window 70 and this is the case ^ 

in the example chosen, the Help Map program initially 40 &vse& the key to the current help~text~to be applied 



ilevel must be selected from the appropriate display such 
as FIG. 3 or 4 or by branching up the map. The highest 
level of help is system level help obtained by branching 
upwards from Facility level help or by selecting contex- 
tual help on the overall application program name. 

One further aspect of the help architecture of FIG. 2 
is the use of branching from displayed Help Text words 
in the Help Text may be made selectable when it is 
created. Selection of such a work with the pointer 



displays the first five child entries in alphabetic order. 
Where the View/Change application entry 71 is the 
parent, the View/Change panel entry 72 is not one of 
the five initially displayed child entries. The Help Map 
window may however be scrolled downwardly as illus- 45 
trated by arrows 73 in its border to bring the View/- 
Change panel entry 72 into view as shown in FIG, 7. 

The various entries are enclosed in boxes which in- 
clude sub-boxes at their left hand margins. The presence 
of an arrow in the sub-box indicates that there are fur- 50 
ther portions of the help map including the particular 
entry. An upward arrow such as 74 indicates that a 
higher level of map structure is available in which the 
View/Change application entry is a child entry. A 
downward arrow such as 75 indicates a lower level of 55 
map structure is available in which the child entry, such 
as View/Change panel is the parent entry. 

Selection of an alternative portions of the Help Map 
is by pointing at the branching arrow and selecting. In 



with the selected word to a Help Text Branch table. For 
each selectable word, the Help Text Branch table con- 
tains a Destination Key which is the key to Correspond- 
ing Help Text in the Help Text Table. The Help Text 
corresponding to the selected word replaces the origi- 
nal Help Text in the displayed window. Thus if the 
words "Column" or "Heading" had been predefined as 
selectable words in the View/Change help text of FIG. 
7, selection of these words with the pointer would have 
produced the Column Heading help text without the 
need to use the Help Map. 

As previously explained, if a word is not predefined 
as selectable, an attempt to select it results in a Glossary 
program being called which displays in yet another 
window, the selected word and its definition or the 
alphabetically nearest words. 

Having described the principles of operation of pre- 
ferred embodiment, illustrated by example, there fol- 



the present, example the pointer 76 is used to select a 60 lows a detailed description of the Help and Help Map 
downward branch from the View/Change panel entry. programs. 



65 
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Figure 3 or 4 or by branching up the map. The highest level of help is 

system level help obtained by branching upwards from Facility level 
help or by selecting contextual help on the overall application program 
name. 



One further aspect of the help architecture of Figure 2 is the use 
of branching" from displayed Kelp Text words in the Kelp Text may be 
made selectable when it is created. Selection of such a work with the 
pointer causes the key to the current help text to be applied with the 
selected word to a Help Text Branch table. For each selectable word, 
the Kelp Text Branch table .contains a Destination Key which is the key 
to Corresponding Help Text in the Help Text Table. The Help Text 
corresponding to the selected word replaces the original Help Text in 
the displayed- window. Thus if the words "Column" or "Heading" had been 
predefined as selectable words in the View/Change help text of Figure 
7, selection of these words with the pointer would have produced the 
Column Heading help text without the need to use the Help Map. 

As previously explained, if a word is not predefined as 
selectable , an attempt to select it results in a Glossary program being 
called which displays in yet another window, the selected word and its 
definition or the alphabetically nearest words. 

Having described the principles of operation of preferred embodi- 
ment, illustrated by example, there follows a detailed description of 
the Help and Help Map programs. 



Program Name: HELP 

The Program consists of a number of "On Blocks" • 
of code and Procedures as defined below. 

Function; An application for providing in context help for 

a general application program. This is the master 
controlling task. This application is a basic 
system component. This task runs for the whole 
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of a PAS session, and provides for the display 

of second level help text, as veil as controlling 
the other tasks. This task runs continuously so' 
that a reasonable response time can be acheived 
for the display of help text. The application 
also has tasks which provide tutorials, glossary 
definitions and a help map. These are all started 
from this task when required. Separate tasks are 
also used for output of information to OS/2 files 
or printers. 

Invocation: Help is started by the general application Control 

when the system is started up. Thereafter, 
any task may run to its QUEUE block, to request 
the display of second level help on a certain 
subject. This normally takes place when a task 
receives a KEL.? event signal, following the user 
pressing Fl-Fl whilst the pointer is over one 
of the tasks windows. First level help is 
provided automatically by the system, for 
the first press of Fl. The subject for which 
help is required is specified 'by settting the 
variables ■ S. Help. Facility' , 1 S. Help. Applicat ion' , 
'S. Help. Panel 1 and 'S. Help. Box' prior to 
running to the QUEUE block of this task. These 
variables will have default values loaded into 
them by the system following an*Fl-Fl, and often 
do not need to be explicitly set by the calling 
task. 

Panels opened: HelpMain 

HelpAABRef 
HelpAABAct 

HelpAABExt 



ON Blocks: 



BREAK 
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DESKTOP 

ERROR 

HELP 

QUEUE 

QUIT 

SCROLL 

SELECT 

START 

STOP 
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Procedures: 



DETSUBJECT Determine help subject. 

EXITSELECT 'Exit' pull-down handler. 

FINDKEYS Find keys for text and tut'l. 

GETTEXT Get text for specified key. 

GETWORD Extract word from string. 

MAKETITLE Set up title boxes. 

BRANCH Branch to new piece of text. 

REFSELECT 'Reference' popdown handler. 

ACTSSELECT 'Output' popdown handler. 

QUEUESUPPORT Queue 'Support' if possible. 

SETPO INTERS Set up pointers to help data. 

TEXTS ELECT Handler for selects on text. 

TUTSELECT 'Tutorial 1 button selects. 



rasks started: 



I.HelpMap 
I.KelpGlos 
I.HelpPr 
I.HelpTut 
General. ShowErr 



Input: 



I .Messages, Help 



Translatable strings used 

by the whole Help 

application, for prompts 
etc. 



General • Messages . 
General 



- Translatable strings for. 
general use by all 
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programs. 



User input - From selections etc. 



S. Help. Facility, 
S • He Ip • Appl ication , 
S, Kelp, Panel, 
S. Kelp. Box 



Define the subject for 
which help text is to 
be displayed. Set prior 
to running this tasks' 
QUEUE block. 



*.HelpIndex.* - Help index tables, which 

occur in DataS tores which 
contain help text or 
tutorials. Used to relate 
the help subject, as 
specified in the 'S.Help.' 
variables, to a title, 
piece of help text and 
tutorial. 



♦.HelpText.* - Help text tables. Used 

to store the pieces of 
help text, 

♦.HelpTxBra.* - Help text branch tables. 

Used to hold the data for 
branches between various 
pieces of help text. 

Output: A screen display of help text, which may 

optionally be output to an OS/2 file or printer. 



Process: The Help application consists of 7 modules which 

have the following functions :- 

Help - This is the main application module. It 
runs continuously, and provides the main help 
text display function. It also controls the 
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starting of the tutorial, help map and glossary 



modules. It uses a separate module to 
handle the printing of help text. It provides 
the variables through which all the modules 
communicate to one another. 



HelpMap - This module is used as a sub-task by 
the Help module. It produces a help map, which 
shows the user all the help text available 
within the system. The help map is used in 
conjunction with the main help text display. 

HelpTut - This module is started as a master task 
by the Help module. It prodvides a tutorial for 
the user, on the specified subject. Once started 
the tutorial can be used independantly of the 
rest of the help system. 

KelpGlos - This module is started as a master task 
by the Help module. It displays glossary 
definitions for words, to the user. Once started 
the glossary car. be used independantly cf the 
rest of the help system. 

HelpPr - This module is started by the Kelp 
module, as a master task. It is used to control 
the printing of help te 

HelpTuPr - This module is started by the HelpTut 
module, as a master task. It is used to control 
the printing of tutorial text. 

HelpGlPr - This module is started by the KelpGlos 
module, as a master task. It is used to control 
the printing of glossary definitions. 



Errors: 



21 5 '" W54 , 

No error should occur during normal running of 

this program. Any that do are unexpected, and 
are passed to the 'ShowErr' program as normal. 



The procedures are described below. 



Procedure name: 



DETSUB3SC 



: unction: 



This procedure determines the subject for which 
Help is required by examining the appropriate 
variables for data passed from the queueing task. 
The variables 'FacName' , 'AppName', f PanName', and 
'BoxName 1 are set to indicate the required Help 
subject. 



Parameters; 



No 



Called by: 
Calls: 



ON QUEUE 



None 



The actions performed by this procedure are as follows:- 
Determine help subject. 

Determine the facility, application, panel and box for which Help has 
been requested. All tasks which queue/run to the Help applications* ON 
QUEUE block pass this information in the appropriate 'S.Help. • 
variables. Ensure that the subject defining variables never contain 
unknown values. 



Procedure name: 



EXITSELECT 



Function: 



This procedure is called whenever a selection is 
made on the 'Exit 1 popdown. 
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Parameters: No 
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Called by: OK SELECT 

Calls: None 

The actions performed by this procedure are as follows 

Exit* pull-down handler. When 'Exit Kelp 1 is selected queue to the stop 

block, which quiesces the application. 

When 'Resume Help* is selected just remove the popdovn. 

Procedure name: FINSKEY5 

Function: This procedure checks the current datastore to see 

if it has a Help index table. If it does it 
searches this for a reference to some Help on the 
specified subject. If an appropriate entry is 
found in the Help index table the procedure 
returns the key to the Help Text in 'TextKey 1 and 
the Tutorial key in 'TutKey'. If either of the 
keys is not found it is set to 0. 



Parameters: Yes 

Called by: ON 
QUEUE 

Calls: None 



The actions performed by this procedure are as follows :- 

Find keys for text and tut'l. Clear the keys. If the datastore contains 
a help index table with a column for help text keys. Search for an 
entry for the required subject in the Help index table. If no entry was 
found for the required subject then no Help Text key is available. If 
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an entry was found in the index then determine the key to the Help 

Text. If the key does not contain a valid value then clear it* If the 
datastore contains a help index table with a column for tutorial 
keys- Search the Help index table for an entry for the specified 
subject. If the subject was a box then ignore the box name and find the 
entry relating to the panel that the box is on. This is because boxes 
do not have their own tutorials, but use those for the panel that they 
exist on. If no entry was found for the required subject then no 
tutorial key is available. Get the Tutorial key. If the key does not 
contain a valid value then clear it* 



Procedure name: 
Function: 



Parameters: 
Called by: 



GETTEXT 

This procedure checks that the current datastore 
contains a help text table, and if it does then it 
attempts. to retrieve the help text specified by 
the ^ key. ~~ IT it" is - successful then this "text" is~ 
put into the vector 'Text 1 otherwise the vector is 
cleared. 
Yes 

BRANCH 

ON QUEUE . Calls: None 



The actions performed by this procedure are as follows :- 

Get text for specified key. 

Clear the vector for returning the text in. 



If the datastore does not have a help text table then no help text is 
available* 

If the specified key is invalid then no text can be found. 
Search for the first line of Help Text* 



If it is not found then no Help Text is available. 
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Retrieve the Help Text by loading lines from the Help Text table into 

the 'Text 1 vector until a line is encountered which has a different key 
to the required Help Text, 



Procedure name: 
Function: 



Parameters: 
Called by; 
Calls: 



GETWORD 

This procedure attempts to determine the word in 
the specified string that occurs at the specified 
character position within that string. If a word 
is found it is returned in 'Word 1 , otherwise a 
null string is returned. The procedure separates 
words using separators defined in the string 
'I. Messages. Help^l3^' • 
Yes 

TEXTSEXiECT 
None 



The actions performed by this procedure are as follows s- 



Extract word from string. 

Check that the values passed in the parameters are valid. 
Define the separators. 



If the character at the specified position is a separator then no valid 
word can be found. 

Search for the start and end of the word, which contains the character 
at the specified position. 



Split the word out of the string. 



Procedure name: 
Function: 

Parameters: 
Called by: 



MAKETITLE 

This procedure sets up the title for the Help Text 
based on the subject for which help was requested. 
Yes 

BRANCH 
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ON QUEUE 
Colls: None 



The actions performed by this procedure are as follows :- 
Set up title boxes. 

If there is no index table column containing titles, set the title to 
show the real facility, application, panel and box names. 

Determine the facility title from the Kelp index table entry for the 
facility. If non is found use the internal system facility name. If no 
facility was specified then use the internal name, which is null. 

Determine the application title in the same way as for the facility 
title. 

Determine the panel title in the same way as for the facility title. 



Determine the box title in the same way as for the facility title. 



Procedure name: 
Function: 



Parameters : 
Called by: 
Calls: 



BRANCH 

This procedure is called when it is required to 
branch to another piece of Help Text in the 
current datastore, specified by , DKey I , The 
procedure checks that the piece ot text exists' and 
has an entry in the Help index table (to provide 
title etc) , before it attempts to execute the 
branching operation. If the branch is successful 
then the flag 'BranchOK' is set, otherwise it is 
cleared. 
Yes 

TEXT SELECT 

GETTEXT 

MAXETITLE 



The actions performed by this procedures are as follows:- 
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Attempt to retrieve the new Help Text. 



Then try to find an entry for it in the Help index table (which 
provides its title, associated facility names etc). 

If both these tests pass then execute the branch: 

Set the new values into the subject defining variables frcm the index 
table entry for the new Help Text. 

Update the Help Text key. 

Attempt to retrieve the key to any related Tutorial from the 
appropriate Help index table entry. 

Hid6 or show the 'Tutorial 1 box, depending on whether one is available 
for the new suoject or not. 

Create the new title for the new text. 

Copy the new text to the screen display. 

Flag the branch as successful. 

Otherwise, if either of the checks failed then flag the branch as 
unsuccessful. 

Procedure name: REFSELEC? 

Function: This procedure is called whenever a selection is 



made on the 'Reference 1 popdown. 



Parameters: 



No 



Calle'd by: 



ON SELECT 



Calls: 



None 



The actions performed by this procedure are as follows:- 
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Reference' popdovr. handler. 

When 'Help Map 1 is selected; 

Set up the variables which are used to pass the Help Map subject to the 
Help Map subtask,.. 

..and either start the subtask or, if it is already active, just queue 
to it. 

When 'Glossary' is selected; 

If the 'Glossary 1 task is not already started,.. 

..set up the variables which are used to pass the Glossary subject to 
the Glossary task,.. 

!..and start it. 

Hide the popdown. 

Procedure name: ACTS SELECT 
Function: This procedure is called whenever a selection is 

made on the 'Output' popdown. 
Parameters: No 
Called by: ON SELECT 

Calls : None 

The actions performed by this procedure are as follows :- 
'Output* popdown handler. 
Hide the popdown. 

Depending on which printing or filing option was selected set the mode 
for the print task accordingly. 

Set the subject defining variables to be passed to the print task. 



35 

Start the Kelp Text print task. 
Procedure name: QUEUESUPPOKT 
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Function: 



Parameters: 
Called by; 
Calls: 



This procedure is called from the 1 ON QUEUE* 
block, at the beginning of the processing of a 
help request. It checks to see if any of the 
support tasks are active, and if there are it 
queues to the appropriate one (providing that it 
is not a request from the task itself) . This 
enables 'Fl' keystroke requests to be routed to 
the support product when it is active, rather than 
producing help requests. If a support task is 
queued to then the flag 'SupportQd'is set, 
otherwise it is cleared. 
No 

ON QUEUE 
None 



The actions performed by this procedure are as follows :- 
Queue 'Support 1 if possible. 
Clear the success flag. 

If the help request is from 'Support' itself, then don't queue back tc 
it. 

Deternane the task handle of the r.ost appropriate active support task 
(if any) • 

If there is one queue to it. The subject is communicated to the supper: 
task via the 'S.Help. 1 variables, which are already set prior to 
cueueing/ running this application. 



Procedure name: 
Function: 



SETPOINTEBS 

This procedure is called from the 'ON QUEUE ' 
Clock. It determines the name of the datastore in 
which Help for the required subject will be found, 



37 



5,179,654 

38 



and sets up pointers to the columns in the help 
index and help text tables in the datastore. if 
any columns of the tables are unusable then the 
pointers to then are set to null strings. 



Parameters: 



No 



Called by; 



TSXTSELHCT 



Calls: 



None 



The actions performed by this procedure are as follows :- 
Set up pointers to help data. 
Set all the pointers to nulls* 

If a datastore is found with the same name as the specified facility 
then use it, else quit here. 

If any of the help index table key columns is missing quit here. 

Set up pointers to the help index table key columns. 

Set up a pointer to the help index table help text keys column, if one 



Set up a pointer to the help index table tutorial keys column, if one 



Set up a pointer to the help index table titles column, if one exists. 

If any of the help text table columns is missing quit here. 

Set up pointers to the help text table text key and lines of text 



If any of the help text branch table columns is missing quit here. 
Set up a pointer to the help text branch table destination key column. 



exists. 



exists. 



columns. 
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Procedure name: 



TEXTS ELECT 



Function; 



This procedure is called whenever a selection is 
made in the area that displays the Help Text in 
the main window (i.e. a when a word of the Help 
Text is selected) . 



Parameters: 



No 



Called by: 



ON SELECT 



Calls: 



GETWORD 



SETPO INTERS 



BRANCH 



The actions performed by this procedure are as follows:- 

Handler for selects on text. 

Determine which word, if any, was selected. 

If no valid word was selected do nothing. 

If a valid word has been selected from the Help Text then check if it 
has been set up to cause a branch, and if it has and the branch is 
possible then branch to the new piece of Help Text, 

Reset the pointers to the help tables in the datastore, in case eithe 
the tables or datastore have been altered. 

Check that a valid Help Text branch table exists in the datastore. 
Check that a branch has been set for the selected word in this piece 



text. 



If it has then attempt to branch to the new Help Text. 



If the -branch was sucessful then don't go on to provide a Glossary 
definition. 
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If a valid word was selected from the Help Text but no branch took 

place, then attempt to find a glossary definition for the selected 
word. 



Sec up the inter task communication variables,, • 

• .and either start the task or, if it is already active, just queue to 
it. 



Procedure name; 
Function: 



Parameters: 
Called by: 
Calls: 



TUTSELECT 

This procedure is called whenever the .'Tutorial 1 
button in the main window is. selected. It sets up 
the variables which are used to pass the subject 
for the Tutorial and either starts or queues to 
the 'HelpTuf task. 
No 

ON SELECT 
None 



The actions performed by this procedure are as follows : - 
'Tutorial 1 button selects. 

Set u? the variables which are used to pass the Tutorial subject to the 
Tutorial task, 



.and either start the task or, if it is already active, just queue to 



ON Name: BREAK 

Function: This block is executed whenever a BREAK occurs 

whilst this task is running. This can only occur 
during the ON START block , and causes the system 
to be shut down, as Help is started during the 
initial system startup. BREAKs are not allowed 
anywhere else as there are no slow processes 
performed. 
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Calls: 



None 



The actions performed by this block are as follows:- 



Create an outstanding BREAK event, which will be detected by Control. 



Then just stop* 



ON Name; 
Function : 



Calls; 



DESKTOP 

This block is executed whenever a desktop 
operation is performed in a window which is owned 
by this task. 
None 



The actions performed by this block are as follows:- 
Clear the prompt area. 

Remove any outstanding 'ShowNote' messages. 

If the desktop operation is a print or zoom then it can be ignored. 

Ignore any panels which are not provided by this pre gran;, specifically 
panels used for the AAB, CAA and prompt areas. 

If the panel that the operation acts upon is not already recorded as 
•being changed then add it's name to the vector of changed panel names. 



ON Name: 
Function: 



Calls: 



ERROR 

This block is called whenever an execution error 
occurs whilst this program is- -running. 
The 'ShowErr 1 program is started to provide some 
diagnostic information for debugging purposes , as 
is standard practice. No errors should occur 
during normal operation of this program, thus no 
attempt is made to trap or handle any. 
None 
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The actions performed by this block are as follows 

For debugging purposes. 
ON Name: HELP 

Function: This block is executed whenever second level 

help is requested in a window which is owned by 
this task* 

Calls: None 

The actions performed by this block are as follows :- 
Clear the prompt area. 

Hemove any outstanding 1 ShowNote 1 messages. 

When Kelp is requested run the task like any other application. 
ON Name: QUEUE 

Function: Programs requesting help queue to this block and 

set the variables S. Help. Facility, 
S. Help. Application, S. Kelp. Panel and s. Help. Box 
to define the level at which the Help is require 
and the exact subject. 

Calls : * QUEUESUPPORT 
DETSUBJSCT 
SETPOINTERS 
MAKETITLE 
FINDKEYS 
GETTEXT 

The actions performed by this block are as follows: - 

Queue to the Support product if active, and if successful do not 
provide any Help. 



Surface (and show if necessary) the main window. 
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Clear the prompt area* 
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Remove any outstanding 1 ShowNote* messages. 
Determine Help subject. 

Determine the datastore that the Help Text will be found in, and set uo 
pointers to the relevant help tables in it- 
Set up the title for the display. 

Search the index in the appropriate datastore for keys to the Help Text 
and an optional Tutorial for the specified Help subject. 

Show the 'Tutorial' box if a Tutorial is available. 

ZzzeTr.pz to get the Help Text. 

Update the display with either the retrieved help text (if there is 
any) or a message to indicate that no help is available. 

Reset the scrolling position. 

ON Name: ' QUIT 

Function: This block is executed whenever a QVIT operation 

is performed on one of the windows owned by this 
task. 

Calls: None 

The actions performed by this block are as follows 
Clear the prompt area. 

Hemove any outstanding 1 ShowNote' messages. 

When 'EscsCancel 1 is selected on one of the popdowns, then hide the 
appropriate popdown. 
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ON Name; SCROLL 

Function: This block is executed whenever the main help 

text window is scrolled. 
Calls: None 

The actions performed by this block are as follows 



Clear the pronpt area. 

Remove any outstanding 'ShowNote' messages. 

Determine how many lines of Help Text there are. 

Find out hcv many can be displayed in the window. 

Scroll the appropriate amount in the requested direction. 

Lir.it the scrolling so that the limits of the text are not exceeded. 

Put out messages if either the start or end of the text has been 
reached. 

ON Name: SELECT 

Function: This block is executed whenever a SELECT takes 

place in one of the windows which is owned by 
this task. 

Calls; TE-XTSELEC? 

TUTSELECT 
EXITSELECT 
REF SELECT 
ACTS SELECT 

The actions performed by this block are as follows 
Clear the prompt area. 

Remove any outstanding 'ShowNote' messages. 
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Depending on where the selection takes place, call the appropriate 

procedure to deal with that selection. 

Selection of a word in the main text area of the main window. 

Selection of the 'Tutorial' button in the main window. 

A selection on the 'Exit 1 popdown. 

A selection on the 'Reference 1 popdown. 

A selection on the 'Output* popdown. 



CN Name: START 

Function: This block is executed when the Help application 

is initialised. This is done once at system 
startup time, by .Control. 

Calls: None 

The actions performed by this block are as follows 



Enable BREAKs. 



Handles for the other tasks within the application. (Set to null if 
task not active.) Variables used for passing data between the various 
tasks in the Help system. 

Pointers to columns in the help index, text and text branch tables. 
They are set by ' SETPOIHTERS ' every time Help is queued to. They are 
set to null if not valid. 

Flag set by 'OUEUESUPPOHT* to indicate when the Support Help Editor has 
seen successfully queued to. 

A vector to record the names of panels changed by DeskTop. 

This is the scrolling control variable for the help text displayed in 
the main window. 
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Internal system names of the facility, application, panel and box for 
which help has been requested. 

Titles of facility, application, panel and box for which Help Text has 
been requested, as displayed at the top of the window. Derived from the 
help index table in the appropriate datastore. 

Keys to the required Help Text and optionally available Tutorial. 

* flag set by the ' BKANCK' procedure to indicate that an attempted 
branch succeeded. 

Vector used fcr holding the required Kelp Text once it has been 
retrieved. 

This is the vector which is used to display the requested Help Text in 
the main window. 

Open panels and windows (including popdowns) . 



OK Name: STOP 

Function: This block is executed whenever Help is to be 

quiesced cr stopped. If it is queued to from 
within the Help application itself then Kelp is 
merely quiesced, otherwise it is stopped. Usually 
Help is only stopped by Control, at the end of a 
session. 

Calls; None 



The actions performed by this block are as follows 

If the program is to be quiesced by queueing from elsewhere within it 
then do that and don't stop it. Also stop the Help Map sub-task. 

Otherwise the application is to be stopped (usually only when the whole 
system is closing down) . 
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First, save any panels that have been changed via Desktop to the 'User' 

catastore. 

If either Glossary, Tutorial or Help Map is active then stop thera in a 
controlled manner (going through their TOP blocks) - This is to ensure 
that any panels which may have been changed are saved. 

Finally, stop the application level task itself. 



Procran Nazte: 



HELPMAP 



This program consists of a number of blocks 
of code and procedures, as listed below 



Function: 



This program is started as a sub-task by the 
'Help' program, when a help map is to be 
provided. 



Invocation: The starting task first sets up the following 

inter-task ccmmunicaticn variables (at the 
application level) : 



A.Temp.Facility 
A, Temp. Application 
A, Temp. Panel 
A. Temp. Box 



Define the subject for 
which the help map is to 
be displayed. The values 
used are the same as 
those placed in the 
'S.Help. ' variables 
when Help itself is 
called. 



Having set up these variables, the starting task 
just starts this program. 



Once this task has been started, the 'A. Temp. 1 
variables can be set up and this program queued 
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to again. This causes this program display a new 
help map, which is appropriate for the newly 
specified help subject. 



Panels oDened: 



HelpMap 



ON Slocks: 



BREAK 

DESKTOP 

ERROR 

HELP 

QUEUE 

QUIT 

SCROLL 

SELECT 

START 

STOP 



Procedures : 



SETLEVELS Set subject levels for nap, 

SETHEADINGS Set titles for map levels. 

SET PARENT Set up parent level of map. 

SETCKILDFACS Set up child level, if fac's. 

SETCKILDAPPS Set up child level, if app's. 

SETCHILDPANS Set up child level, if pan's. 

SETCHILDBOXS Set up child level, if boxes. 

UPDATEDISP Refresh the whole help map. 

DOWNSEL Down arrow select handler. 

UPSEL Up arrow select handler, 

PARENTSEL Parent box select handler. 

CHILDSEL Child box select handler. 



Tasks started: 



General. ShowErr 



Input: 



I, Messages. Help 



Translatable strings used 
by the whole Kelp 
application , for prompts 
etc. 
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General • Messages . 
General 
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Translatable strings for 
general use by ail 
pre grams . 



User input 



From selections etc. 



A. Temp . Facility , 
A. Temp. Application , 
A. Temp .Panel, 
A- Temp, Box 



Define the subject for 
which a help map is to 
be displayed. Set prior 
to running this tasks' 
QUEUE or START blocks. 



♦.Helplndex.* - Help index tables, which 

occur in DataStores which 
contain help text cr 
tutorials. Used to build 
the help mao. 



A screen display of a help map, which shows 
in a structured way most of the help text 
available. 



This program is started by the main ! Help' task 
as a master task. It may also be queued to by it. 
Prior to starting or queueing it the 'A.Temp.*' 
variables are set up to indicate the subject 
around which the help map should be drawn. The 
user may move round the help map and select items 
of help text to be displayed in the main help 
text window. When this is done this task queues 
back to the main help task to get the help text • 
displayed. 

No error should occur during normal running of 
this program. Any that do are unexpected, and 
are passed to the 'ShowErr' program as norr.al , 



Deoencencies: 



5,179,654 

61 62 

A help index table must be present in the system 

DataStore before a map can be created, as this 
forms the root of the mao tree. 



Procedure name; 



SETLZVE1S 



Function: 



This procedure inspects the variables 'FacName 1 , 
'AppName 1 , •PanName' and 'BoxName' to determine 
what the subject of the Help Map should be. It 
checks that the requested Help. can be accessed 
from the top of the Kelp tree {i.e. it is not 
isolated) . In cases where the Help for the 
required subject is isolated or non-existant the 
variables are modified to make the subject of the 
Help Map the next most relevent Help at a higher 
level. As well as checking the subject 
specifying variables, the procedure sets the 
variables 'ParentLevel* and 'ChildLevel' , which 
determine what level of Help is displayed on each 
of the two levels of the mao. 



Parameters: 



No 



Called by: 



DOWNSZL 

UPSEL 

ON QUEUE 



Calls: 



None 



The actions performed by this procedure are as follows 



Set subject levels for map. 



Check that the System level help is installed, and if it is not 
terminate the Help Map and issue an error message. 



If the facility is 'System 1 or unspecified then system level help will 
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be used for the subject of the Help Map, arid the appropriate levels set 
and checking stopped here. 

Determine which datastore the Help for the specifed facility will be 
found. If the datastore does not exist backup to the system level. 

If no Help table exists in the datastore which is supposed to contain 
the Help for the specified facility then revert to system level Help 
ar.c erase the facility name from 'FacName* etc. 

Set up indirect references to the appropriate Help index table. 

If r.o entry for facility Help exists in the appropriate table then 
revert to system level Help and erase the facility name from TacNane' 
etc. 

If Help for the specified facility exists but there is no Help at 
application level, then erase all lower level references from •AppName 1 
etc and revert to system level for the top level of the map. 

If the specified subject does not go below the facility level then step 
checking here and set the appropriate levels. 

If no entry for application Help exists in the appropriate table then 
revert to facility level Help and erase the app'n name from 'AppName' 
etc* 



If Help for the specified app'n exists but there is no Help at panel 
level, then erase all lower level references from 'PanNane' etc and 
revert to facility level for the top level of the map. 

If the specified subject does not go below the app'n level then step 
checking here and set the appropriate levels. 



If no entry for the panel Help exists in the appropriate table then 
revert to app'n level Help and erase the panel name from •PanName* etc. 



5,179,654 

65 66 

If Kelp for the specified panel exists but there is no Kelp at box 

level, then erase all lower level references from 'BoxName 1 and rever 
to application level for the top level of the map. 



If the specified subject does not go below the panel level then stop 
checking here and set the appropriate levels. 

If no entry for the box Kelp exists in the appropriate table then 
revert to panel level Hel? and erase the box name from 'BoxNane'. 



Otherwise a valid bcx level subject has been specified. 



Procedure nar.e: 
Function: 



Parameters: 
Called by; 
Calls: 



setkeadzxgs 

This procedure sets the appropriate headings 
above the parent and child boxes on the panel, 
depending on the settings of 'ParentLevel 1 and 
•ChildLevel\ 
No 

' UPDATEDISP 
None 



The actions performed by this procedure are as follows 



Set titles for map levels. 



Procedure name: SETPAKENT 

Function: This procedure sets the appropriate title into 

the parent box depending on the level set for it 
in •ParentLevel 1 and the subject of the Help Map 
as defined by 'FacName 1 etc. It also sets the 
uparrow if the level of the parent box is below 
system level. 

NO 

UPDATEDISP 
None 



Parameters: 
Called by: 
Calls: 



The actions performed by this procedure are as follows:- 
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Set up parent level of map. 
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Determine which datastore the Help in the parent box is in. 

Set up indirect reference to the titles column in the appropriate hel 
index table. 

Set the parent box title. 

Set the uo arrow if it is valid. 



Procedure name: 
Function: 



Parameters: 
Called by: 
Calls: 



SETCKILDFACS 

This procedure sets the titles into the child 
boxes when the Help to be displayed in them is at 
facility level. It also determines the names of 
the real facilities associated with each title 
and sets the down arrows for those facilities 
which have application level Help. 
No 

UPDATEDISP 
None 



The action performed by this procedure are as follows:- 



Set up child level, if fac ! s. 



Clear the temporary arrays used to hold the data for the child boxes. 



For each datastore active in the system. 

Xcnore the system datastore. 

Ignore any datastore with no help index table. 



Set up indirect references to columns in the appropriate Kelp index 
table. 
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Search for the entry for facility level help in the datastore, and if 

it is not found ignore the datastore* 

Get the title for the facility level help. 

If title is unknown or blank ignore this datastore. 



If title is a duplicate ignore this datastore. ■ 

Otherwise this datastore contains valid facility level Help. The Kelp 
title and datastore name are loaded into the appropriate vectors and 
the entry in the down arrows vector cleared. 

If the facility has application level help below it, which has a valid 
title and can thus be displayed on the Help Map, then set the down 
arrow for it. 

Finally, once the data for the child boxes has been set up in the 
temporary arrays, sort the temporary arrays into the final arrays for 
the child boxes, . . 



..and initialise the scrolling position. 



Procedure name: 
Function : 



Parameters: 
Called by.: 
Calls: 



SETCHILDAPPS 

This procedure sets the titles into the child 
boxes when the Help to be displayed in them is at 
application level. It also determines the names 
of the real applications associated with each 
title and sets the down arrows for those 
applications which have panel level Kelp. 
No 

UPDATED IS? 
None 



The action performed by this procedure are as follows:- 
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Set up child level, if app's. 

Determine the datastore that the app'n Help will be found in. 
Clear the temporary arrays used to hold the data for the child boxes. 
Set up indirect references to the appropriate Help index table. 
Find no of table entries. 
For each index table entry. 

If the entry is for box or panel or facility level Help ignore it. 
If title is unknown or blank ignore the entry, 
If title is a duplicate ignore the entry. 

Otherwise just load the app'n ..and initialise the scrolling help info 
into the appropriate position, temporary vectors and clear the down 
arrows vector entry. 



Then, set the down arrow er.tr/ if the app'n has panel level Help below 
it, which has a valid title and can thus be displayed on the Kelp Map. 

Finally, once the data for the child boxes has been set up in the 
temporary arrays, sort the temporary arrays into the final arrays for 
the child boxes, . . 

..and initialise the scrolling position. 
Procedure name: SETCHILDPANS 

Function: This procedure sets the titles into the child 

boxes when the Help to be displayed in them is at 
panel level. It also determines the names of the 
real panels associated with each title and sets 
the down arrows for those applications which have 



73 



5,179,654 



74 



box level Help. 



Parameters: 



No 



Called by: 



updated: s? 



Calls: 



None 



The actions performed by this procedure are as follows? - 
Set up child level, if pan's. 

Clear the temporary arrays used to hold the data for the child boxes. 
Determine the datastore that the panel Help will be found in. 
Set up indirect references to the appropriate Help index table. 
Find no of table entries. 

Find the first entry for the application in the Help index table. 
For each index table entry concerning the appropriate application. 
If the entry is for box or application level Help ignore it* 
If title is unknown or blank igncre the entry. 
If title is a duplicate ignore the entry. 

Otherwise just load the panel Help info into the appropriate temporary 
vectors and clear the down arrows vector entry. 

Then, set the down arrow entry if the panel has box level Help below 
it, which has a valid title and can thus be displayed on the Help Map. 

Move on to the next entry in the index table if there is one. 

Finally, once the data for the child boxes has been set up in the 
temporary, arrays, sort the temporary arrays into the final arrays for 
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. .ar.d initialise the scrolling position. 



Procedure name: 



SETCHILDBOXS 



Function; 



This procedure sets the titles into the child 
boxes when the Help to be displayed in them is at 



box level. It also determines the names of the 



real boxes associated with each title and clears 



the down arrows. 



Parameters: 



No 



Called by: 



UPOATEDISP 



Calls: 



None 



The actions performed by this procedure are as follows:- 
Set up child level, if boxes. 

Clear the temporary arrays used to hold the data for the child boxes. 



Set up indirect references to the appropriate Kelp index table. 
Fir.c no of table entries. 

Find" the position of the first box in the index table. 

For each index table entry concerning boxes on the appropriate panel. 

If title is unknown or blank ignore the entry. 

If title is a duplicate ignore the entry. 

Otherwise just load the box Help ir.fo .into the appropriate temporary 
veczcrs and clear the down arrows vector. 



Determine the datastore that the box Kelp will be found in. 



Move on to the next entry in the index table if there is one. 
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Finally, once the data for the child boxes has been set up in the 

temporary arrays, sort the temporary arrays into the final arrays for 
the child boxes, . . 

..and initialise the scrolling position. 



Procedure name: 
Function: 
Parameters: 
Called by: 



Calls: 



UPDATED! SP • 

This procedure updates the Help Map display. 
No 

DOKNSEL 

UPSEL 

OX QUEUE 

SETHEADINGS 

SETPARENT 

SETCKILDF ACS 

SE7CKILDAPPS 

SETCHILDPANS 

SETCHILDBOX5 



The actions performed by this procedure are as follows: - 
Kefresh the whole help map. 

Set the heading's above the parent and child boxes. 
Set up the parent box and up arrow. 

Set up the child boxes and down arrows (using an appropriate procedure 
for the level of the child box contents). 



Procedure name: 
Function: 



Parameters: 
Called by: 



DCWNSEL 

This procedure is called whenever a down arrow is 
selected. It sets the subject defining variables 
to give the appropriate next level of help down 
and refreshes the Help Map. 
No 

ON SELECT 



5,179,654 

79 80 

Calls: SETLEVELS 
UPDATEDISP 

The actions performed by this procedure are as follows 

Down arrow select handler. Check that the down arrow is valid. 

Then, depending on the current child level set the subject defining 
variables to indicate the next level down., 

..and refresh the map. 

Procedure name: UPSEL 

Function; This procedure is called whenever the up arrow is 

selected. It sets the subject defining variables 
to give the next level of help up and refreshes 
the Hel? Map. 

Parameters: No 

Called by: OK SELECT 

Calls: SETLEVELS 
UPDATEDISP 

The actions performed by this procedure are as follows 

Up arrow select handler. 

Check that -he up arrow is valid. 

Then, depending on the current parent level set the subject defining 
variables zo indicate the next level up. . 

..and refresh the map. 

Procedure name: PARENTSEL 

Function: This procedure is called whenever the parent box 

on the Kelp Map is selected. It queues to the 
Help master task with a request to display the 
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Help Text for the subject which corresponds to 

the parent title. 
Parameters : No 
Called by; ON SELECT 

Calls: None 

The actions performed by this procedure are as follows 
Parent box select handler. 

Depending on the level of the parent box set the appropriate data into 
the variables which are normally set before cueueing Help,.. 

..and queue to the Kelp application just like a normal request. 

Procedure name : CKILDSEL 

Function: This procedure is called whenever a child box on 

the Kelp Map is selected. It queues to the Kelp 
master task with a request to display the Help 
Text for the subject which corresponds to the 
child title. 

Parameters: No 

Called by: ON SELECT 

Calls: None 

The actions performed by this procedure are as follows:- ■ 
Child box select handler. 

Check that the child box has a valid title in it. 

Depending on the level of the child boxes set the appropriate data into 
the variables which are normally set before queueing Help,.. 

••and queue to the Help application just like a normal request. 



ON Name: 



BREAK 
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Function; This block is executed whenever a BREAK occurs 

whilst this task is running. This only occurs , 
during the ON START block, and causes this task 
to stop. BREAKs are not allowed anywhere else, as 
there are no slow operations. 
Calls: None 



The actions performed by this block are as follows 
Flag the Help Map as stopped, and stop. 
CX Name: DESKTOP 

Function: This block is executed whenever a desktop 

operation is performed in a window which is owned 
by this task. 

Calls; None 

The actions performed by this block is as follows 

If the panel is changed via DeskTop then record the fact so that it can 
be saved away when the subtask is stopped. 

ON Name; ERROR 

Function; This block is called whenever an execution error 

occurs whilst this program is running. 
The 'ShowErr' program is started to provide some 
diagnostic information for debugging purposes, as 
is standard practice. No errors should occur 
during normal operation of this program, thus no 
attempt is made to trap or handle any. 

Calls: None 



The action performed by this block is as follows:- 
For debugging purposes* 



ON Name: 



HELP 
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Function: This block is executed whenever second level 

help is requested in a window which is owned by 
this task. 
Calls: None. 



The action performed by this block is as follows: - 

When help is requested just run the task like any other application, 

ON Name: QUEUE 

Function: Tasks queue to this block to refresh the Kelp Map 

so that it is set up for a particular subject. 
It determines the level of help to be shown on 
each of the two levels of the. map and the 
specific subject around which the map should be 
based. 

Calls: SET LEVELS 



The actions performed by this block are as follow$j- 

Detennine the intended subject of the help map (these must never become 
unknown). The 'A. Temp. 1 variables are always cleared after usage. 

Determine the levels of help to be displayed at each of the map levels. 
Update the map display with the info for the appropriate levels and 
subject. 



Surface the window. 



ON Name: -QUIT 

Function: This block is executed whenever a QUIT operation 

is performed on one of the windows owned by this 
task. 

Calls: None 

The action performend by this block is as follows :- 



When ■Esc^Cancel' is selected terminate the task. 
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ON Name: SCROLL 

Function: This block is executed whenever the help map 

window is scrolled. 
Calls: None 

The actions performed by this block are as follows 

Determine how many child titles there are. 

fine out how many can be displayed in the window. 

Scroll the- appropriate amount in the requested direction . 



Limit the scrolling. to ensure that the ends of the data are not 
exceeded and hide and show the boxes which indicate if there is more 
data in either direction. 

CM Name: SELECT 

Function; This block is executed whenever a SELECT takes 

place in one of the windows which is owned by 

this task. 
Calls: • UPSEL 

DOWNS EL * 

PARENTSEL 

CHXLDSEL 

The action performed by this block is as follows:- 

Depending on where the select takes place on the Help Map, call an 
appropriate procedure to deal with it. 

ON Name: START 

Function: This block is executed when the Help Map part of 

the help application is started. This is usually 
when the 'Help Map 1 button on the main help text 
'Reference' pull-down has been selected. 

Calls: None 
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The actions performed by this block are as follows:- 



Enable BBEAXs. 

This is the scrolling control variable for the child boxes on the help 
map. 

Flag to record if the panel has been changed via 'DeskTop* . 

Internal system names of the facility, application, panel and box fcr 
which a Help Map has been requested. 

Level of help for each of the two levels of the help map, ( May be 
'System 1 , 'Facility' , 'Application 1 , 'Panel 1 , or 'Box'.) 



The titles of the help at the higher and lower levels of the Help Map, 
as displayed in the appropriate boxes. 

The real nar.es of the entities whose titles are displayed in the chile 
boxes. 

The arrows that indicate if the user can move up or down the map frcm a 
given item. 

Open panel and window. 

Queue to* the 'ON QUEUE' block to refresh the display. 
ON Name: STOP 

Function: This block is executed whenever the program is 

to be stopped. This is usually by queueing from 
elsewhere within it, e.g. from the code which 
handles the 'Esc^Quit 1 button. 

Calls: None 



The actions performed by this block are as follows:- 
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..save the panel if it has been changed via DeskTop,,, 
. ,flac the Kelp Map as stopped, ♦ , 



. .and stop. 
We claim: 

1. A data processing system comprising: 

means for displaying panels of information relating to 
at least one task, the panels being viewable through 20 
at least one window; 

operator input means for providing interactive com- 
munication with the system including means for 
identifying the displayed information including a 25 
visible indicator, viewable on said display means 
for identifying selectable information; 

means for communicating, associated with said visi- 
ble indicator, an operator selection to the system 
and, for requesting help information from the sys- 30 
tern; 

an addressable store of hierarchical help text informa- 
tion; 

contextual help means responsive to a request for 
help and to a current state of the system, defined by 
plural system state variables, to access the help text 
store and obtain appropriate help text and display 
said help text through one of said windows, said 
system state variables being ranked based on the ^ 
current system state, and hierarchical help text 
information having corresponding help text is dis- 
played such that specific system state variables are 
associated with low order help text and often sys- 
tem state variables are associated with high order 43 
help text; 

help map display means for displaying in a separate 
window, concurrently with said help text and in- 
formation relating to the at least one task, at least a 
portion of a hierarchical map of the stored help text so 
corresponding to a current one of the system state 
variables; and 

means for replacing the help text in the help text 
window with help text corresponding to the a se- 
lected entry from said help map. SS 

2. A system according to claim 1 wherein said system 
variables are applied as addressing information to a key 
table to produce a key which is an address for accessing 
a unit of help text in said help text store. 

3. A system according to claim 2 wherein, said system 60 
variables comprise: 

a panel order of help text, corresponding to the dis- 
played panel of information in which said indicator 
is located; 

a low order system state variable, associated with said 65 
low order help text, that corresponds to the loca- 
tion of the indicator within a predefined box in the 
displayed panel of information; 



a high order system state variable, associated with 
said high order help text, that corresponds to a 
program application responsible for displaying the 
panel of information; and 

a facility order of help text that has a higher system 
state variable than said high order system state 
variable. 

4. A system according to claim 3 wherein said help 
map display means comprises selectively operable 
branching means for causing display of a new help map 
after selection of a branching function for a given map 
entry that is a low order system state variable or high 
order system state variable. 

5. A system according to claim 4 wherein said dis- 
played map entries comprise icons, indicating the per- 
mitted direction of branching, selectable by the opera- 
tor via said operator input means when said visible 
indicator is positioned on one of said icons. 

6. A system according to claim 5 further comprising 
help text branching means, responsive to the selection 
of selectable branch words included within the body of 
said help text being currently displayed, for accessing 
related help text in the help text store, for replacing the 
original help text with said related help text, and for 
displaying said related help text. 

7. A system according to claim 6 further comprising 
a glossary store wherein selection of a help text word, 
other than said selectable branch words, cases display of 
a glossary window containing a definition of the se- 
lected word or the alphabetically nearest words. 

8. A method of presenting help information in a data 
processing system, comprising: 

displaying panels, viewable through a window, of 
information relating to at least one task; 

providing interactive operator communication with 
said data processing system, 

providing an addressable store of hierarchical help 
text information by identifying items displayed on a 
screen of a display within said data processing 
system by selecting said items with a variable indi- 
cator, communicating the operator selected items 
to the data processing system and requesting help 
information from the data processing system; 

obtaining and displaying appropriate help text from 
said addressable store; 

concurrently displaying said appropriate help text, 
the information relating to the at least one task and 
at least a portion of a hierarchical help map, corre- 
sponding to a current state of said system as defined 
by plural system state variables, said system state 
variables being ranked based on the current system 
state and hierarchical help text information, associ- 
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ated with said hierarchical help map, having corre- 
sponding help text displayed such that specific 
system state variables are associated with low 
order help text and other system state variables are 
associated with high order help text; and 5 
replacing the help text currently displayed with help 
text corresponding to a selected entry from said 
hierarchical help map. 

9. A method according to claim 8 wherein said step of 
concurrently displaying help text, comprises addressing 10 
a key table using said system state variables to produce 

a key which is an address for accessing a unit of help 
text in said help text store. 

10. A method according to claim 9 wherein said step 
of concurrently displaying system state variables com- 13 
prises: 

displaying a panel order of help text, corresponding 
to the displayed panel of information in which said 
indicator is located; 

displaying a low order system state variable, associ- 
ated with said low order help text, that corre- 
sponds to the location of the indicator within a 
predetermined box in the displayed panel of infor- 
mation; „ 

displaying a high order system state variable, associ- 
ated with said high order help text, that corre- 
sponds to a program application responsible for 
displaying the panel of information; and 

displaying a facility order to help text that has a 3Q 
higher system state variable than said high order 
system state variable. 

11. A method according to claim 10 wherein said step 
of providing interactive operator communications, 
comprises causing display of a new help map after sec- 35 
tion of a branching function for a given map entry that 

is a low order system state variable or high order system 
state variable. 

12. A method according to claim 11 wherein said step 
of concurrently displaying said help text comprises 40 
displaying icons, indicating the permitted direction of 
branching, selectable by the operator when said visible , 
indicator is positioned on one of said icons. 

13. A method according to claim 12 further compris- 
ing' 45 

accessing related help text in the help text store; 
replacing the original help text with said related help 

text; and 
displaying said related help text. 

14. A method according to claim 13 further compris- so 
ing providing a glossary store wherein selection of a 
help text word, other than said selectable branch words 
causes display of a glossary window containing a defini- 
tion of the selected word or the alphabetically nearest 
words. 55 

15. A computer program implanted on a data process- 
ing system and for controlling said data processing 
system to display help information to a user of said 
system, comprising: 

means for displaying panels, viewable through a win- 60 
dow, of information relating to at least one task; 

interactive operator communication means for pro- 
viding operator input to said data processing sys- 
tem to identify items displayed on a display screen 
within said data processing system by selecting said 65 
display items, to communicate the selected items to 
said data processing system and for requesting help 
information from the data processing system; 



an addressable store of hierarchical help text informa- 
tion; 

means for obtaining and displaying appropriate help 
text from said addressable store; 

means for concurrently displaying said appropriate 
help text, information relating to the at least one 
task and at least a portion of a hierarchical help 
map, corresponding to a current state of said sys- 
tem as defined by plural system state variables, said 
system state variables being ranked based on the 
current system state and hierarchical help text in- 
formation having corresponding help text is dis- 
played such that specific system state variables are 
associated with low order help text and specific 
system state variables are associated with high 
order help text; and 

means for replacing the help text currently displayed 
with help text corresponding to a selected entry 
from said hierarchical help map. 

16. A computer program according to claim 15 
wherein said means for concurrently displaying help 
text, comprises means for addressing a key table using 
said system state variables to produce a key which is an 
address for accessing a unit of help text in said help text 
store. 

17. A computer program according to claim 16 
wherein said means for concurrently displaying system 
state variables comprises: 

means for displaying a pane) order to help text, corre- 
sponding to the displayed pane of information in 
which said indicator is located; 

means for displaying a low order system state vari- 
able, associated with said low order help text, that 
corresponds to the location of the indicator within 
a predetermined box in the displayed panel of in- 
formation; 

means for displaying a high order system state vari- 
able, associated with said high order help text, that 
correspond to a program application responsible 
for displaying the panel of information; and 

means for displaying a facility order of help text that 
has a higher system state variable than said high 
order system state variable. 

18. A computer program according to claim 17 
wherein said interactive operator communication 
means, comprises means for causing display of a new 
help map after selection of a branching function for a 
given map entry that is a low order system state variable 
or high order system state variable. 

19. A computer program according to claim 18 
wherein said means for concurrently displaying said 
help text comprises means for displaying icons, that 
indicate the permitted direction of branching, said icons 
being selectable by an operator when said visible indica- 
tor is positioned on one of said icons. 

20. A computer program according to claim 19 fur- 
ther comprising: 

means for accessing related help text in the help text 
Store; 

means for replacing the original help text with said 

related help text; and 
means for displaying said related help text. 

21. A computer program according to claim 20 fur- 
ther comprising a glossary store wherein selection of a 
help text word, other than said selectable branch words 
causes display of a glossary window containing a defini- 
tion of the selected word or the alphabetically nearest 
words. 
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1 2 

AUDIO/VIDEO STORAGE AND RETRIEVAL features a video teleconferencing "answering machine" 

FOR MULTIMEDIA WORKSTATIONS which allows a user to leave an audio/video "filmclip" 

message on another workstation for later playback of the 

RELATED APPLICATIONS message by the user of the other workstation. 

Tnis application is a continuation of application Ser. No. 5 \ a » «? aspect the invention features a method 

07/915,088 filed Jul. 16, 1992 now U.S. Pal. No. 5,623,690 ?° d a PP aratus k^ 0 ™ 8 ^ » ud '° and ****** 

which is a Continuation-in-Pan of US. Ser. No. 07/893,074, » 8 file «x»m*toby ■ multimedia computer workstauon. 

filed Jun. 3, 1992 and U.S. Ser. No. 07/893,234. filed Jun. 3, The «n|nit« workstations include a storage means for a 

.gg 2 workstation to store audio and video data as digital data 

10 packets to the data file, and retrieval means for the work- 

BACKGROUND OF THE INVENTION station to retrieve audio and video data from the data file. 

The data file is accessible using, for instance, a TCP/IP 

Video communications has evolved over the years from a protocol socket, 

simple video telephone concept to a sophisticated network j D embodiments, the storage means and retrieval 

for allowing multiple users to participate in a video telecon- J5 means each „, clud e a software process executing on the 

ference. For full featured video teleconferencing, users workstation. The storage process formats and stores audio 

require both an audio communications path and a real time ^ vidco data t0 ^ e data gj c as dala pac k etef an d the 

visual communication path synchronized to the audio path. retrieval process retrieves the data packets from the data file 

Furthermore, it is desirable to support full color video and and reconstructs the audio and video data stored by the 

telephone quality audio. Video teleconferencing capabilities 20 storage process for audible and visual reproduction, respec- 

are limited mainly by the bandwidth of the transmission vidco data ^ presented as an image on the display 

medium connecting the teleconferencing terminals. of tbe wor kstation, while the audio data is sent to either 

Many computer workstations used in the office or labo- amplified speakers or headphones, 
ratory environment today are connected with other | n preferred embodiments, the storage means includes an 
workstations, file servers, or other resources over high-speed 25 aud i 0 st0 rage means for storing an audio data stream from 
local area networks, Local area networks, in turn are often (ne workstation to the data file such that tbe audio date can 
connected together through high-speed gateways which con- bc rctri eved from the data file and reconstructed by the 
nect workstations which may be distributed over a wide workstation into a continuous audio signal. The storage 
geographic area. Network wide protocols allow worksta- m6ans also mc i udcs vi deo storage means for storing video 
tions to exchange packets of data at high rates of speed and 30 dala t he workstation to the data file such that each 
reliability. Fixed bandwidth digital and analog video chan- 0 f video data stored to the data file is inserted into the 
nels have been combined with computer networks to imple- audio data slrcan) also m trjc dala fij e Dy me wor k- 
mem some video teleconferencing features. These include station without affecting the continuity of the audio signal 
high bandwidth CATV/FDM type analog channels and fixed retrieved from the data file and reconstructed by the work- 
allocation TDM data channels for the video data. 35 station. 

SUMMARY OF THE INVENTION . In °f ° ,ber Pf?™" t ^T^J ia ^* 

is attached to each frame of video data stored to the file. The 

Workstations today have obtained unprecedented compu- timing information indicates a point in the continuous audio 

tational power and utility. The powerful RISC type CPUs 40 data stream which corresponds in time to the frame of video 

and fast, high resolution graphical displays have made data. The retrieval means includes a synchronizer for dis- 

possible multimedia workstations which integrate live audio playing a frame of video dala, retrieved from the dala file, on 

and video into the programming environment. Graphical the display of the workstation when the point in the audio 

User Interface operating systems (GUI) have allowed effec- data stream, retrieved from the data file, corresponding to 

live integration of audio and video into application program- 45 the timing information of the retrieved video frame is 

ming. audibly reproduced by the workstation. The synchronizer 

The present invention provides means for storing and °™nts the amount of audio dala retrieved in the continuous 

retrieving synchronized audio/video "filmclips" to and from audio stream and compares the count to the timing infor- 

a data file of a multimedia computer workstation. The file nation stored along with the most recently retrieved video 

storage apparatus and protocol of this invention provides for 50 franie to determine when to display the frame, 

the storage and retrieval of high quality synchronized video In general, in another aspect, the invention features a 

and audio data in a format which is compatible with the multimedia computer workstation, such as a RISC worksta- 

video teleconferencing and messages of this invention. The tion or IBM PC, having audio/video "filmclip" storage and 

invention uses the teleconferencing protocol of this disclo- retrieval capabilities, The multimedia workstation of this 

sure to store an audio/video "filmclip" file similar to the way 55 invention includes a video source for providing sequential 

the audio and video teleconference data is sent across a frames of digitized video data. An audio source provides a 

network to a remote workstation during a teleconference. digitized audio data stream that represents a continuous 

The teleconferencing protocol is also used to replay the audio signal synchronized to the sequential frames of digi- 

audio/video "filmclip" file similar to the way the audio and tized video data, Storage means provides for storing the 

video teleconference data is received across a network from 60 audio and video data to a data file such that each frame of 

a remote workstation. Advantageously, the audio and video video data stored to the data file is sequentially inserted into 

is reconstructed from the "filmclip" file as it is serially read the audio data stream without affecting the continuity of tbe 

out of the file, so all the data in the file need not be present audio signal represented by tbe audio data stream. Retrieval 

in the working memory of the computer before playback can means provides for retrieving the audio data stream and the 

occur. Timing information is embedded into the data stored 65 sequential frames of video data from the data file. Audio 

in the file and provides for easy synchronization of the reproduction means provide for audibly reproducing the 

reconstructed audio and video. The present invention also retrieved audio data stream into a continuous audio signal. 
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Display means provide for displaying the retrieved sequen- FIG. 3 is a block diagram showing the software environ- 

tial frames of video data on the display of the workstation meat for implementing a preferred embodiment of a DEC- 

syncbronized to the reproduced audio signal. spin video teleconferencing application for implementing 

In preferred embodiments, the video source includes a the video teleconferencing features of the system of FIG. 1. 

video camera, a video tape recorder, and/or a video laser disk 5 FIG. 3(a) is a block diagram showing the implementation 

player providing sequential frames of analog video. A video of a "filmclip" file for storage and playback of audio and 
frame grabber captures, digitizes, and stores each frame of video using the protocol of this invention, 

analog video. A video compressor may compress the video FIG. 4 is a block diagram showing the one-way connec- 

data using JPEG or MPEG compression. The audio source uons established between two workstations to implement a 

includes a microphone for live audio, or pre-recorded audio io j^^y teleconference. 

corresponding to frames of pre-recorded video from for nGS ^ m fa di mustrati tne mu]ti , 6 

instance a video tape recorder or laser disk. An audio one-way video teleconferencing connection! established 

digitizer digitizes and stores the audio using mu-law com- betwec > ^ workstations ^ ^ the ^ te , e confer- 

P ression " „ ence. 

In general, in yet another aspect, the invention features a 15 «^ c . a . _ .„ . a - - . 

w *i ' «gi * . r 'j FIG. 6 is a flowchart illustrating the now of video during 

multimedia "filmclip message storage apparatus for a video *d t 1 f 

teleconferencing workstation. The message storage appara- a vi eo e econ erence. 

tus includes a receiver for receiving an audio and video F1G * 7 « a flowchart illustrating the teleconferencing 

"filmclip" message from a remote source across a digital folocol of this invention for establishing a video lelecon- 

data network as digital data packets. The receiver stores the 20 fercnce connection between two workstations. 

received audio and video data packets to a "filmclip" data FIG. 8 illustrates the formal of the START message of the 

file accessible by the workstation. Retrieval means provide teleconferencing protocol of this invention. 

for retrieving the audio and video "filmclip" message from FIG. 9 illustrates the format of the OK message of the 

the data file. teleconferencing protocol of this invention. 

Preferred embodiments of the message apparatus include 25 fjg. 10 illustrates the format of the STARTHEADER 

means for informing a user of the workstation that an audio message of the video teleconferencing protocol of this 

and video "filmclip" message has been received by the invention. 

workstation. Screening means allows for monitoring the FIG. 11 illustrates the format of the QUIT message of the 

audio and video "filmclip" message as it is being received ^ teleconferencing protocol of this invention, 

from the remote source ^ mG ^ iUustrates the format of the ANSWERMACHINE 

In other preferred embodiments, the receiver and retrieval m of lhe teleconferencing protocol of this invention, 

means each include a software process executing on a _ ° ... , . , . ~~*,™ rt r 

processor of the workstation. The receiver process receives ^G. 13 illustrates the format of the CONTTROL message 

the audio and video message data packets formatted by the 3S of the teleconferencing protocol of this invention, 

remote source and stores the data packets to the "filmclip" ^G. M is a flowchart showing the audio and video data 

data file as received from the remote source. The retrieval transfer sequence of the video teleconferencing protocol of 

process retrieves the data packets from the "filmclip" data fois invention. 

file and plays back the audio and video "filmclip" stored by FIG. 14(a) is a flowchart showing the storage of audio and 

the receiver process. ^ video data to a "filmclip" file using the video teleconfer- 

Id other preferred embodiments, the audio message data encing protocol of this invention, 

are formatted by the remote source and stored to the data file FIG. 14(b) shows the resulting structure of audio and 

by the workstation so thai an audio data stream can be video data stored in a "filmclip" file by the process shown in 

retrieved from the data file and reconstructed by the work- FIG. 14(a). 

station into a continuous audio signal. The video data are 45 FIG. 15 shows the format of the AUDIOHEADER mes- 

formatted by the remote source and stored to the data file by sage of the video teleconferencing protocol of this invention, 

the workstation such that each frame of video data is inserted pr G 16 shows the format of the VIDEOHEADER mes- 

into the audio data stream also stored in the data file without of the video teleconferencing protocol of this invention, 

affecting the continuity of the audio signal retrieved from the HG 1? ^ timm tf rf (he ^ gnd video 

data file and reconstructed by the workstation. 50 dala synchronization of vi / co teleconferencing protocol 

BRIEF DESCRIPTION OF THE DRAWINGS of this invention. 

Iht foregoing and other objects, features and advantages ™- « s^ws the top level graphical user interface 

of the invention will be apparent from the following more «ndow for controlling a video teleconferencing session of 

particular description of preferred embodiments of the 55 ^ inventl0D - 

invention, as illustrated in the accompanying drawings in FK3- U> shows the graphical user interface window for 

which like reference characters refer to lhe same parts displaying video data received from another workstation 

throughout the different views. The drawings are not nec- during a video teleconferencing session of this invention, 

essarily to scale, emphasis instead being placed upon illus- FIG. 20 shows a second level graphical user call list 

trating the principles of the invention, 60 interface window for establishing the video teleconferencing 

FIG. 1 is a pictorial representation of the distributed connections to other workstations of this invention, 

computer system featuring multimedia workstations having FIG. 21 shows a second level control graphical user 

video teleconferencing capabilities of this invention. interface window for adjusting the parameters for a video 

FIG. 2 is a block diagram showing a preferred embodi- teleconference of this invention, 

ment of the multimedia workstation for implementing the 65 FIG. 22 shows a second level monitor graphical user 

video teleconferencing features of the distributor computer interface window for monitoring the parameters of a video 

system of FIG. 1. teleconference of this invention. 
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FIG. 23 shows a second level documentation graphical 
user interface window for obtaining information about the 
operation and features of a video teleconference of this 
invention. 

FIG. 24 shows a third level documentation graphical user 
interface window for obtaining information about a topic 
selected from the second level user interface window of FIG. 
23. 

FIG. 25 shows a graphical user interface window of a ring 
box for announcing a video teleconference call to another 
workstation to establish a video teleconference of this inven- 
tion. 

FIGS. 26(a>-26(Jt) show the display screens of three 
Workstations participating in a three-way video teleconfer- 
ence of this invention. 

FIG. 27 is a flowchart showing the pixel decimation and 
replication video compression technique of this invention. 

FIGS. 28(a>-28(c) show the compression and reconstruc- 
tion of a frame of video data using the pixel decimation and 
replication technique of FIG. 27, 

DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

EG. 1 shows a distributed computer system 10, having a 
plurality of multimedia workstations 12 connected by a high 
speed digital network 14, which features n-way video tele- 
conferencing of this invention. Each of the multimedia 
workstations 12 is capable of producing live audio and video 
data for transmission across the network to another multi- 
media workstation. Further, each of the multimedia work- 
stations is capable of sonically reproducing the audio data 
and visually reproducing the video data received from 
another workstation. 

Two or more of the networked workstations can partici- 
pate in an n-way video teleconference using the teleconfer- 
encing protocol of this invention. The teleconferencing 
protocol of this invention allows real time synchronized 
audio and video transmission across the network without the 
use of a fixed bandwidth or dedicated time slot transmission 
medium. Rather, this invention provides high performance 
video teleconferencing features using standard digital net- 
work transport level protocols such as Internet TCP/IP and 
UDP/IP, or DECnct™, The physical network link 14 should 
be a high speed FDDI (Fiber Distributed Data Interface) 
fiber optic link running at 100 MB/Sec. for maximum 
performance (about 15 uncompressed black and white 
frames per second), but can also be virtually any type of high 
quality digital network link such as an Ethernet™. In the 
case of the FDDI network link, performance is typically 
limited by the workstation hardware and software, rather 
than by the throughput of the network. In addition, wide area 
networking (WAN) technologies, such as Tl and T3 digital 
carriers, can be used with the video teleconferencing pro- 
tocol of this invention. These WAN technologies can be 
expected to achieve a video frame rale of at least about 12 
Hz, assuming black and white video images compressed 
with JPEG, MPEG, or another video compression technique. 
The features of one preferred embodiment of this invention 
are commercially embodied in the DECspin™ product 
available from Digital Equipment Corporation, Maynard, 
Mass., the assignee of this patent application. 

FIG. 2 shows a preferred embodiment of the multimedia 
workstation 12 for implementing the video teleconferencing 
protocol of this invention. Workstation 12 includes a high 
performance processor 20 connected to a large working 
memory 22 having 24 megabytes or more capacity, and a 
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large hard drive having 1 gigabytes or more capacity. A high 
performance backplane channel 26 connects the processor, 
memory, and hard disk to other devices in the workstation. 
The workstation is coupled to the digital network com- 

5 munications link 14 through 8 network controller 28 con- 
nected between the network link 14 and the backplane 
channel 26. The workstation is also coupled to a voice grade 
telephone line 29 through a modem 31 connected between 
the backplane channel and the telephone line. Similarly, the 

to workstation can be connected to other digital data conver- 
sation services, such as the ISDN digital telephone network. 

Multimedia workstation 12 includes a color video frame 
grabber 34 for capturing and digitizing frames of video from 
one or more analog video inputs 36. Video inputs 36 are each 

15 connected to a video source, such as a video camera 38 
providing live analog video signals, or an auxiliary video 
storage device 40, such as a VCR or video laser disk player 
providing stored analog video signals. The analog video 
signals may be of any standard types such as NTSC, 

20 SECAM, or PAL. 

The multimedia workstation 12 also includes a video 
bulfer 35 which stores a frame of full color video graphics 
and characters generated by the workstation for display on 
a 1280x1024 pixel color monitor 30. The video buffer 35 

25 (and associated buffer controller) is connected to the back- 
plane channel 26 for receiving video data from the processor 
20. The video buffer is also connected to a video display 
subsystem 36 which converts the stored video frame data 
into analog signals for driving the color monitor 30. 

30 The video frame grabber 34 stores its digitized video data 
directly into a predetermined area of the video buffer 35. 
Thus, the digitized video input to the workstation by the 
frame grabber appears directly in a predetermined area on 

35 the monitor 30, without having to pass through processor 20 
or main memory 22. Further, processor 20 can read back the 
captured video frame data from the video buffer, store the 
data in main memory 22, and further process the video data 
according to the video teleconferencing protocol described 

40 herein. 

Frame grabber 34 digitizes and stores each frame of video 
from an analog video source and can deliver up to 30 frames 
per second of digitized 640x480 true color (24 bits) of 
NTSC/SECAM/PAL video into video frame buffer 35. A 
4 5 dedicated hardware video compression subsystem 37 can 
also be connected to the backplane channel 26 to provide 
high performance video compression of the digitized video 
data. 

The audio features of the multimedia workstation 12 are 
50 implemented using an audio controller 42 connected to the 
backplane channel 26 for interfacing audio signals into the 
workstation and reproducing audio signals out of the work- 
station. An audio distribution box 44 is connected to the 
audio controller for directing audio to and from audio 
55 devices such as a microphone 46, a headphone 48, and/or a 
telephone receiver 50, Auxiliary audio devices such as a 
recording device, a CD player, or amplified speakers may 
also be connected to the distribution box 44. Audio control- 
ler 42 receives audio input from the distribution box and 
60 digitizes the audio using an 8 bit mu-law encoder at 64 kbits 
per second or less to match typical telephone voice grade 
audio standards (8 kHz bandwidth). For convenience, the 
headphones 48 and microphone 46 may be combined into a 
single headset. 

65 In one commercial embodiment available from Digital 
Equipment Corporation, multimedia workstation 12 is built 
around a DECstation™ 5000/200 workstation in which 
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processor 20 is an R3000™ RISC processor and backplane 
channel 26 is a TurboChannel™ (TQ bus. Network con- 
troller 28 is a DEC FDDIcontroller 700™, Frame grabber 
34/video buffer 35/video display subsystem 36 is a 
DECvidco/in™ Turbo Channel compatible video system, 
and audio controller 42 is a DECaudio™ T\irboCbannel 
compatible audio controller. 

Alternatively, multimedia workstation 12 can be built 
around a person computer platform, such as an IBM™ 
compatible PC. Preferably, the PC should have a high speed 
Intel 80386™, 80486™, or successor processor. The PC 
should be compatible of running in the Microsoft Win- 
dows™ or Windows NT™ graphical operating system envi- 
ronment. 

Workstations and PCs of different performance levels can 
all participate in the same video teleconference using the 
video teleconferencing protocol of this invention. For 
instance, less powerful or slower PC's and workstations can 
simply communicate at a slower video rate with the more 
powerful workstations, without affecting the overall video 
rate between other workstations. 

The effective video frame rate of a video teleconference 
depends to a large extent on the quantity of video data 
handled by a workstation during each video frame. Video 
compression techniques can greatly enhance the effective 
frame rate of the video teleconference especially over lower 
data transfer rate services such as ISDN. Standard compres- 
sion methods such as JPEG (Joint Photographic Experts 
Group), MPEG (Motion Picture Experts Group) and Px64 
can be implemented using a dedicated hardware subsystem 
37 which have recently become available. 

A video compression technique which has been found 
useful for use with the video teleconferencing protocol of 
this invention features pixel decimation and replication 
(PDR). This PDR technique effectively subsamples by Vi a 
full frame of video pixels in the vertical (Y) and horizontal 
(X) directions. Thus, a frame of video captured by the frame 
grabber is reduced to one quarter of its original size. The 
subsampling is accomplished by a scaling function featured 
on the frame grabber 34 of FIG. 2. 

Reconstruction of the image is implemented in software 
by replicating every pixel received twice along a line, and 
then replicating the reconstructed line as the next line of the 
restored image. The replicated line is shifted by a single 
pixel to prevent any pixel block patterns from forming. 
Results have shown acceptable quality of the received 
image, while offering significantly increased system 
throughput and performance. 

FIG. 3 shows a diagram of the DECspin™ product 
software system environment for a preferred embodiment of 
this invention. Generally, the Digital Teleconferencing Pro- 
tocol (DTP) is implemented, by a DECspin™ application 
program 60 which resides at the application layer of the 
standard ISO 7-layer network model. The DTP video tele- 
conferencing protocol of this invention is used to transfer 
audio and video data between workstations, as well as 
between local applications (loopback), and for storing and 
retrieving audio and video data to and from a disk file. 

The DECspin application program 60 runs on top of an 
Ultrix™ (V4.2a or its successors) (UNIX™) 62 operating 
system. All communications between the DECspin applica- 
tion 60 and the UNIX operating system 62 are handled via 
UNIX system calls 64. The DECspin application program 60 
is written as an X Windows™ application running under a 
Motif™ X Windows manager. A description of the Ultrix, X 
Windows, and XI 1 programming environments can be 
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found in "ULTRIX Worksystem Software, X Window Sys- 
tem Protocol: X Version 11," Digital Equipment 
Corporation, order number AA-MA98A-TE, Maynard, 
Mass. (1988, Version 2.0), the contents of which are incor- 

5 poraled herein by reference. A description of the Motif 
programming environment can be found in Open Software 
Foundation, "OSF/Motif Programmer's Guide," Prentice 
Hah\Englewood Oiffs,N.J. 07632(1991, Revision 1.1), the 
contents of which are incorporated herein by reference. 

10 Through UNIX system calls the DECspin application 
establishes local TCP/IP "sockets" for communication with 
various software servers providing multimedia services for 
the DECspin application. The creation and use of UNIX 
"socket" system calls for creating TCP/IP application con- 

15 nections is discussed in detail by Comer, D.E., "Internet- 
working With TCP/IP, Val 1: Principles, Protocols, and 
Architecture, Second Edition" Prentice Hall, Englewood 
Oiffis, N J. (1991) (pp 337-346), the contents of which is 
incorporated herein by reference. The DECspin application 

20 communicates with an audio server application 66 which 
provides audio services using X Windows Xmedia com- 
mands 68 through a local TCP/IP "socket". The DECspin 
application communicates with a video X Windows Xserver 
application 70 which provides video services using Xll and 

25 XV extension commands 72 through another local TCP/IP 
"socket". DECspin communicates with a Motif based 
graphical user interface (GUI) 74 through yet another local 
TCP/IP "socket". 
The DECspin application communicates with a DEC- 

30 spind "slave" application 78, running on either the local or 
a remote workstation using the DTP video teleconferencing 
protocol 80 via another "socket". The DECspind application 
is a UNIX "deamon" version of the DECspin application 
which is "slaved" to a DECspin "master" application run- 

35 Ding on either the local or a remote workstation. The 
DECspind application is used to receive, reconstruct, 
synchronize, and display audio and video data sent to it from 
either a local or remote DECspin application using the DTP 
protocol. Where the DECspind application is operating on 

40 the local workstation, the "socket" is a local TCP/IP 
"socker. Where the DECspind application is operating on a 
remote workstation, the "socket" can be cither a remote 
TCP/IP or DECnet "socket". 
Furthermore, as also shown in FIG. 3(a), the DECspin 

45 application 60 can store audio and video data to a system 
"filmclip" file 82 using the DTP video teleconferencing 
protocol via another local TCP/IP "socket" 84. This creates 
a stored "filmclip" audio and video data stream which can be 
played back from the "filmclip" file 82 using a DECspind 

so application 78. That is, a DECspind application 78 creates a 
local TCP/IP "socket" 83 to the stored file, receives data 
through the socket via the same DTP protocol and plays 
back the stored audio and video to the user. This is the 
equivalent of the DECspind application receiving the audio 

ss and video data directly from a DECspin application via the 
DTP video teleconferencing protocol, but without the 
acknowledgement protocol discussed below. 

FIG. 4 shows a schematic model of two workstations 12a 
and 12b connected across network 14 during a two-way 

60 video teleconference run Tinder the DECspin application. 
Each "two-way" video teleconferencing connection estab- 
lished between two workstations is composed of separate 
"one-way" connections. Each one-way connection operates 
in a "data pushing" mode. That is, audio and video data are 

65 "pushed" from the originating workstation to the receiving 
workstation. This "push" model provides a high degree of 
security since it prevents another network user from 
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remotely activating workstation's audio and video from 
across the network. 

To originate a video teleconference call to another 
workstation, a first workstation 12a (Workstation A) 
executes a local DECspio application program 100 which 
acts as a "master". DECspin "master" 100 first establishes a 
one-way network connection 102 with a second workstation 
12b (Workstation B) by invoking execution of a DECspind 
"slave" application program 104 on Workstation B. Digi- 
tized audio and video data are sent from Workstation A by 
DECspin application 100 to Workstation B where they are 
received by the DECspind application 104. Furthermore, 
DECspind application 104 signals 106 the user of Worksta- 
tion B to indicate that a video teleconference call has been 
received from Workstation A. In response to the signal, a 
local DECspin "master" application program 108 on Work- 
station B establishes a separate one-way network connection 
110 with Workstation A by invoking execution of a DEC- 
spind "slave" application program 112 on Workstation A. If 
the DECspin application 108 on Workstation B is not 
currently executing when the signals 106 occur, the DEC- 
spin application 108 is executed and places a return call to 
Workstation A. The return call to Workstation A causes the 
execution of DECspind application program 112. Audio and 
video signals from Workstation B are sent by DECspin 
application 108 to Workstation A where they are received by 
DECspind application 112 to complete the two-way video 
teleconferencing connection between the workstations. 

FIG. 5a symbolically shows the two one- way video 
teleconferencing connections of FIG. 4 between Worksta- 
tion A and Workstation B, FIGS. Sb and 5c symbolically 
show the addition of a third workstation 12c (Workstation C) 
to the video teleconference. As shown in FIG. 5b, Worksta- 
tion A first establishes a video teleconference with Work- 
station C independent of Workstation A's video teleconfer- 
ence with Workstation B, This new video teleconference is 
invoked by Workstation A in a manner identical to the 
invocation of the conference between Workstation A and 
Workstation B as shown in FIG. 4, i.e., by creating two 
one-way connections 102a and 110a between the worksta- 
tions using DECspin and DECspind application programs 
running on the two workstations. 

Once a video teleconference between Workstation A and 
Workstation C is established, Workstation C and Worksta- 
tion B likewise establish two one-way connections 102Z> and 
1106 as shown in FIG. 5c to complete the video teleconfer- 
encing connections. This can occur by either Workstation B 
calling Workstation C, or by Workstation A "joining" all the 
workstations into the same conference by sending a "join" 
control message to each of the other workstations. Upon 
receipt of the "join" message, each workstation places a call 
to each other, unconnected workstations. Thus, each work- 
station participating in a particular video teleconference 
establishes and maintains a two-way video teleconference 
connection with each other workstation in the teleconfer- 
ence. In this manner, a teleconference participant can control 
what each other participant receives from that workstation, 
e.g., muting audio or pausing video to certain participants 
while remaining active to other participants. Furthermore, if 
a participant has a workstation which can only operate at a 
limited capacity, each participant can treat that workstation 
differently from the other workstations, without affecting the 
overall performance of the video teleconference for the other 
participants. For example, an audio only workstation can 
still participate in a teleconference without affecting the 
video distribution among the other workstations. 

It should be noted that each workstation will run only a 
single DECspin application, which may establish a connec- 
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tion with one or more remote workstations. However, each 
workstation will execute one DECspind "slave" application 
session for each workstation to which a video teleconference 
connection is established. That is, each workstation runs a 

5 single DECspin "Master" application, but may run multiple 
DECspind "Slave" applications simultaneously. 

In one preferred embodiment, a single "master" DECspin 
application can be connected to up to seven DECspind 
"slave" applications simultaneously. Further, all the DEC- 

10 spind applications need not be members of the same video 
teleconference. For instance, one workstation may simulta- 
neously be connected to two separate video teleconferences, 
one with three members and one with four members, for a 
total of seven DECspind applications driven from a single 
DECspin application. The members of each conference can 

15 only see and hear the members of the same conference. Any 
workstation common to both conferences can "join" the 
conferences, in which case all seven members will be joined 
into a single conference where all can see and hear each 
other. 

20 FIG. 6 is a block diagram showing the flow of video from 
one workstation to another. The video data source (38 or 40 
of FIG. 2) provides standard NTSC, SECAM, or PAL analog 
video signals 200 which are digitized and stored 202 in a 
video frame buffer 35 by the frame grabber 34 (FIG. 2). 

25 Once an entire video frame has been digitized and stored in 
the frame buffer, the entire frame of video data is transferred 
204 to an application buffer in main memory 22 (FIG. 2) 
which is assigned to the DECspin application. Once the 
video data has been transferred to the application buffer, the 

30 video frame grabber can begin to digitize and store the next 
video frame in the frame buffer. 

The digitized video data in the DECspin application 
buffer is next packaged for decoding and reconstruction by 
the receiving DECspind application, and is sent to the 

35 network transport buffer 206. The video data in the network 
buffer are packetized according to the network protocol in 
use, e.g., TCP/IP or DECnet, sent 208 across the network, 
and received 210 into a receiving network buffer. The video 
data is reconstructed from the network protocol packets and 

40 sent 212 to a DECspind application buffer in main memory 
22 (FIG. 2) of the receiving workstation. The video data are 
accumulated into the DECspind application buffer until a 
full frame of video has been received. Graphics are added to 
the video to form a composite video image for display. The 

45 composite video image is then sent 214 to the frame buffer 
from which the digitized composite video image is con- 
verted for display 216 on the workstation monitor. 

FIG. 7 is a flowchart showing the commencement of a 
video teleconference between a local workstation, Worksta- 

50 tion A, and remote workstation, Workstation B. To begin a 
teleconference, the user of Workstation A invokes 300 the 
execution of the local DECspin application, The executing 
DECspin application causes the creation of a network 
"socket" 302 through a standard UNIX system call. Creation 

55 of the socket on Workstation A causes the creation of a 
corresponding "port" 304 on the remote Workstation B, This 
"socket-to-port" connection establishes a peer-to-peer con- 
nection for the DECspin and DECspind applications running 
on the two-connected workstations. That is, data put into the 

60 "socket" on Workstation A are transferred to the port on 
Workstation B via a standard network protocol such as 
TCP/IP or DECnet. UNIX treats the established socket as a 
standard file descriptor to which the DECspin application 
simply sends the data stream to be transferred to Workstation 

65 B. Thus, this data transfer operation is transparent to the 
DECspin application which simply accesses the "socket" 
through standard UNIX calls. 
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Once the "socket" to Workstation B is established, DEC- the DECspin application through the application invocation 
spin sends a START message 306 through the "socket" to command line. If the DECspin application is already run- 
Workstation B. FIG. 8 shows the format of the START ning on Workstation B (e.g., supporting another video 
message, which is simply a two byte long data string. teleconference in progress), the DECspind application will 

Upon receipt of the START message, Workstation B 5 append the parameters received via the STARTHEADER 

invokes execution 308 of a DECspind "slave" application message into an information file used by the executing 

which connects to the previously created port 304 to receive DECspin application. This information file is in turn used to 

data from the "socket" on Workstation A. Once the DEC- control execution of the DECspin application. Only one 

spind application verifies 310 this end-to-end connection DECspin application may be executing on a workstation at 

between the two workstations, DECspind sends 312 an OK 10 one time. However, multiple DECspind applications may be 

acknowledgement message through the "port" back to the running on the same workstation. 

DECspin application. FIG. 9 shows the format of the OK Alternatively, if the DECspind application running on 

message, which is simply a two byte data stream. Workstation B receives the STARTHEADER message and 

Upon receipt of the OK message from the "socket," the roe user does not want to, or cannot participate in the video 

DECspin application sends 316 a STARTHEADER message 15 teleconference, the workstation returns 228 a QUIT message 

through the "socket" to the DECspind application which is to the DECspin application on Workstation A. FIG. 11 shows 

used to set up 318 the parameters for the current video th e format of the QUIT message, which is a two byte data 

teleconferencing session. FIG. 10 shows the format of the string. Upon receipt of the QUIT message, the DECspin 

STARTHEADER message, the fields of which convey the application on Workstation A terminates the connection with 

parameter information required by the DECspind applica- 20 ^e DECspind application on Workstation B. 

tion. These parameter fields include a video width field 400 As another alternative, the DECspind application running 

and a video height field 402 for setting the initial DECspind on Workstation B can respond to the STARTHEADER like 

picture size. A bits per pixel field 404 sets DECspind to a telephone answering workstation by returning an 

display either a black and white image (8 bits) or a true color ANSWERMACHINE message back to the DECspin appli- 

image (24 bits). A frame rate field 406 sets the desired initial 25 cation. FIG. 12 shows the format of the ANSWERMA- 

frame rate, A frame count field 408 sets the number of CHINE message which is also a two byte data string. The 

frames expected to be sent during the video teleconference. DECspin application running on Workstation A allows the 

The value of this field is set to -1 for a live video telecon- user to respond to the ANSWERMACHINE message by 

ference (to indicate infinity) where the total number of sending a fixed length (typically 20 seconds) audio and 

frames to be sent is indefinite. Otherwise, the actual number 30 video message to the DECspind application on Workstation 

of frames to be transferred during the session is entered into B where it is stored in a "filmclip" file for deferred playback 

the field, e.g., for a video message of predetermined dura- by the user. The audio and video message may also be 

tion. A login/user handle field 410 identifies the calling party viewed by the user of workstation B as it is arriving for 

and is used by DECspind to set up the return audio and video storage, similar to "screening" an incoming telephone call, 

connections from Workstation B to Workstation A. Finally, 35 FIG. 13 shows the format of a CONTROL message, the 

a DTP (DECspin teleconference protocol) flag field 412 fields of which convey control information and commands 

conveys multiple single bit flags which indicate particular between workstations participating in a video teleconfer- 

operational modes such as video compression type used (if cnce . specifically, a two byte identifier field 450 identifies 

any) audio encoding type used, whether to expect audio, mc CONTROL message. At which field 452 identifies the 

video, or both, or how DECspind should respond to certain u (V p e of control message to follow, and a length field 454 

commands. indicates the length of the control message. A flag field 456 

Once DECspind receives the STARTHEADER and deter- conveys other information about the CONTROL message to 

mines 320 that it will participate in the video teleconference the receiving workstation, for instance whether or not an 

with Workstation A, it issues another OK message to the 4S acknowledgement message should be sent to the originator 

DECspin application on Workstation A. The receipt 322 of of the CONTROL message upon its receipt, 

this OK message causes the DECspin application to begin One type of CONTROL message is a "JOIN" message, 

transmission 324 of audio and video data to the DECspind jhis message is sent by a local workstation to all remote 

application on Workstation B. workstations currently participating in a video teleconfer- 

Furthermore, when the user answers the call the DEC- 50 cnce with the local workstation to join all the workstations 

spind application invokes execution of its own local DEC- into the same video teleconference. As discussed above, a 

spin application, which establishes a return connection for workstation may carry on more than one video teleconfer- 

sending return audio and video data from Workstation B to ence simultaneously without the other participants being 

Workstation A, to complete the two-way video teleconfer- connected to each other. Upon receipt of a "JOIN" CON- 

ence. The DECspin "master" application now running on 55 TROL message, each of the remote workstations places a 

Workstation B establishes communications with a DEC- video teleconference call to each of the other remote work- 

spind "slave" application on Workstation A in a process stations which are currently connected to the local worksta- 

equivalent to that just described with respect to establishing tion but not to that remote workstation. In this manner, 

communications between workstation A and workstation B. individual dual one-way video teleconferencing connections 

In this case, however, Workstation B is viewed as the local ^ are established between each of the workstations that has 

workstation, and Workstation A is viewed as the remote been "joined" into the teleconference. It should also be noted 

workstation. that any workstation can leave the teleconference without 

With respect to the invocation 326 of the DECspin affecting the teleconference among the removing worksta- 
application on Workstation B, this may occur in one of two tions by simply terminating its video teleconference con- 
ways. If there is no DECspin application currently running 65 ocction to each of the workstations, 
on Workstation B, then DECspind initiates execution of the FIG. 14 is a flowchart showing the synchronized trans- 
DECspin application, and passes the required parameters to mission of digitized audio and video data from a DECspin 
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application running on a local workstation, Workstation A, 
to a DECspind application running on a remote workstation, 
Workstation B. Video data are collected on a continuing 
frame by frame basis. One frame is collected and stored in 
the frame buffer of the frame grabber 34 (FIG. 2) until the 
frame is transferred to the DECspin application buffer in 
main memory 22 (FIG. 2) for transmission across the 
network to a DECspind application, or until the frame is 
discarded to make room for collection of a new video frame. 
Digitized audio data are collected into an audio data buffer. 
The audio data is drawn out of the audio buffer by the 
DECspin application which sends the audio data as a con- 
tinuous stream to the DECspind application. 

The audio and video data sent across the network can be 
modeled as frames of video data inserted into a continuous 
stream of audio data. In general, the DECspin application 
will not discard audio data, but will discard video frames as 
necessary. Since the ear differentiates sound and the eye 
integrates images, breaks in the audio are more objection- 
able to a listener than breaks in the video are to a viewer. As 
a result, the highest priority of the DECspin application is to 
deliver a continuous, unbroken digitized audio stream to the 
DECspind application. On the other band, video frames are 
routinely discarded dependent on network throughput, and 
other workload factors. 

After a video frame has been digitized and stored in the 
frame grabber buffer, the frame is made available 350 to the 
DECspin application for transfer to the DECspind applica- 
tion running on Workstation B. Digitized audio stored in the 
audio buffer, up to the time when the frame becomes 
available, is sent 352 first to the DECspind application. The 
DECspin application begins the audio data transmission by 
sending an AUDIOHEADER message through the "socket" 
to the DECspind application. FIG. 15 shows the format of 
the AUDIOHEADER message, the fields of which convey 
information about the audio data to follow. Specifically, a 
two byte identifier field 414 identifies the AUDIOHEADER 
message, a length field 416 indicates the amount of digitized 
audio data to follow the AUDIOHEADER message, and an 
audio flag field 418 indicates parametric information about 
the audio data. One such audio flag, for instance, indicates 
the type of audio encoding used to digitize the audio signal, 
e.g., nw-law encoding. Packets of up to 16 kB each of audio 
data are then sent to the DECspin "socket" immediately 
following the AUDIOHEADER message. The audio data 
packets are reassembled into a continuous audio data stream 
by the receiving DECspind application, and the audio is 
sonically reproduced. 

Next, the frame of available video data 350 is sent 354 
from the DECspin application to the DECspind application 
immediately following the audio data. The DECspin appli- 
cation begins the video frame transmission by sending a 
VIDEOHEADER message through the socket to the DEC- 
spind application. FIG. 16 shows the formal of the VIDEO- 
HEADER message, the fields of which convey information 
about the frame of video data to follow. Specifically, a two 
byte identifier field 420 identifies the VIDEOHEADER 
message. A video width field 422 and video height field 424 
indicate the size of the video frame to follow the VIDEO- 
HEADER message. A control flag field 426 conveys para- 
metric information about the video data frame. Finally, a 
timing information field 428 carries a time stamp which 
helps the DECspind application to realign the audio and 
video data for synchronized reconstruction at workstation B. 
The lime stamp is a numerical value corresponding to the 
byte count of the continuous audio stream taken at the end 
of the current video frame. 
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A full frame of digitized video data is senl from the 
DECspin application to the DECspind application immedi- 
ately following the VIDEOHEADER message. The DEC- 
spin application then stops sending data through the 

5 "socket" 356 until it receives an OK message (FIG. 9) from 
the DECspind application which acknowledges receipt and 
successful reconstruction of the full video frame. 

The video frame data are broken into data packets of 32 
kB or less to facilitate efficient transmission through the 

10 "socket" and across the network by ihe TCP/IP protocol. 
Although the video data could be sent through the "socket" 
as a single, unbroken stream of approximately 300 kbytes of 
data (for a black and while image having 640 by 480 pixels, 
each 8 bits deep), any error occurring at the TCP/IP protocol 

15 level would require retransmission of the entire 300 kbyte 
data stream. Therefore, by breaking the data into smaller 32 
kbyte maximum size packets, any error at the TCP/IP 
protocol level will only require retransmission of at most 32 
kbytes of video data. This significantly increases the effi- 

20 ciency of video transmission across the network which 
results in a higher overall video throughput. 

The DECspind application collects the received video 
data packets into an application buffer until an entire frame 
of video data has been collected. At that time, the DECspind 

25 application proceeds to display the received video frame to 
the workstation user, and issues an OK message (FIG. 9) to 
the DECspin application to acknowledge receipt and suc- 
cessful reconstruction of the video frame. 

The DECspin application responds to the OK message 
sent by the DECspind application in one of three ways. The 
response depends on when the OK message is received 
relative to the time required for the video frame grabber to 
make the next video frame available, i.e., "the frame time" 

35 between available frames. FIG. 17 illustrates the timing and 
operations associated with the receipt of the OK message by 
the DECspin application, and is discussed in detail below. 

The first situation occurs when DECspin receives the OK 
message within two frame times 358 (FIG. 14) of sending 

40 ,the last available video frame to ihe DECspind application. 
In this case, DECspin returns 360 to determine if 350 a new 
video frame is available from the frame grabber buffer, and 
the entire process of sending audio and video data to the 
DECspind application is repeated. 

45 The second situation occurs when DECspin receives the 
OK message beyond two frames times 362, buLless than a 
"time out" time period, after sending the last available video 
frame to the DECspind application. In this case, DECspin 
first sends 364 the digitized audio accumulated in the audio 

so buffer to the DECspind application to prevent loss of this 
audio data which would result in a break in the continuity of 
the reconstructed audio. DECspin then proceeds to return 
360 and determine 350 if a new video frame is available 
from the frame grabber buffer for transmission, and the 

55 entire process of sending audio and video to the DECspind 
application is repeated. 

The third situation occurs when the DECspin application 
has not received an OK message within a specified "tim- 
eout" period 366. In a preferred embodiment, the timeout 

60 period is set at one half second. A timeout can occur when, 
for instance, the network is reset, or a processor intensive 
operation is being performed at the receiving workstation 
which competes with the DECspind application for work- 
station resources. In timeout situations, loss of part of the 

65 continuous audio signal as well as pari of Ihe video signal is 
unavoidable. In this case, the DECspin application continu- 
ally trims 368 the audio buffer to only retain audio data 
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corresponding to the last time out interval, which prevents associated reconstructed video frame until an audio time 

overflow of the audio buffer. For instance, where the timeout stamp generated from the received audio data stream 

interval is one half second, DECspin only retains the last one matches the video frame time stamp. Hie video frame is 

half second of audio data in the audio buffer. Finally, when displayed when the match occurs. In this manner, the audio 

DECspin receives the OK message 370 from the DECspind 5 always appears to be synchronized to the displayed video 

application, DECspin first sends 364 the last half second of frames, regardless of the video frame rate or the loss of 

digitized audio accumulated in the audio buffer, and then intervening video frames. 

proceeds 360 to determine 350 if a new frame of video data CTO * . „ fl _ . . , f . „ r ™^,„ r„ r 

is available from the frame grabber buffer, and the entire F ? G " 14 ^> 1S . a flowchart showmg he procedure for 

process of sending audio and* deo to the DECspind appli- in synchronized audio and video data to a multimedia 

cation is re eated filmclip file accessible by a local workstation. This pro- 

,!.„ . ' . . ., j.. . ,.».•. cedure is similar to the synchronizediransmission of audio 

FIG. 17 illustrates a more detailed timing analyse of these sodyitieodmbetvnxa rWo workstations represented by the 

three video frame acknowledgement situations. At time t,,, flowcharts of pjC-S. 7 and 14. 

the frame grabber begins to capture a digitized video frame A ... , . . . . . .. „ 

in its buffer, which becomes available for transmission by 1S cl A "«F of *• v S* sU ? on , of V ±, C,, P 

the DECspin application at time t,. At time I,, video " by invoking 300a the execution of a ocal DECspu, 

FRAME1 fe transferred from the frame grabber buffer to the «PPtouon_ Tue executog DECspin application causes the 

DECspin application buffer in main memory, and the frame %* u ™ ° f » •° cal "^ k " 2° 2fl , 10 """St 6 ' 

grabber begins to accumulate the next frame FRAME2, in fl,e » s, » n d * rd V™****™*? 1 ™! 

the frame crabber buffer target file can reside on the local workstation hard drive 24 

™ . .. \ . . . , ... 20 (FIG. 2) or on a networked file server accessible through the 

Jne DECspu. application then begms to send the audio ^ orksl / tjon ^ark interface. Inlhecaseofa'-filmclip-file 

and video data to the DECsp.nd apphcation shortly after ^ ^ an .. answeri macbinc » m on another 

Ume t,. If the acknowledgement OK message for FRAME1 remote wortetati , he f , file resides £ the message 

roISS?- ?l? Spl H- ? fe T- ^ aSB areaofmeremoteworkstotionandis^cessedfromthelocal 

FRAME2 . available at lime i.e during the ACK1 „ b , remole TCP/IP "socket", 

mterval, then DECspin waits until time t 2 to begin sending _ . .. . , L * 

the audio and video FRAME2 data. If the acknowledgement 0 QCC , tbc f^f l ° l A ^^P file * CSt /£ l **l' 

OK message for FRAME1 is received from DECspind after "? ECs P in *"ds316a a STARTHEADER message (FIG. 10) 

FRAME2 is available at time t, but before the next video for storage in the file Tins stored 

frame, FRAME3, is available from the frame grabber buffer 30 meSSag !l * 10 St0re f °™ 1 °f ? C ™? 10 ^ 

at time t 3 , i.e., during the ACK2 interval, then DECspin da < a *° d * ™* t0 *f"P tbe P^T^^T^ ^ 

begins immediately sending the audio data accumulated in wUI 1**3*"* the audio and video data from the file, 

the audio buffer and video frame FRAME2 to the DECspind Next, audio and video data arc stored to the "filmclip" file 

application. « m a serial fashion. Video data are collected on a continuing 

In the case where the acknowledgement OK message is 35 frame b ? framc basis ' video frame has been digitized 

received greater than two frame limes after video framc J* stored in the video buffer 35 by the frame gabber 34 

FRAME1 became available from the frame grabber buffer at 2) ' lhe £rame " m * 6 ? a ™ lab ? I 5 *? l ° the 

time t 1( e.g., after time t 3 during the ACK4 time interval, the DBCs P m a PPl"»tion for storage in the "filmchp file. Digi- 

currently available video framc is FRAME3 which became Uzed audl ° stored 10 lhe audl ° buffers U P l ° tbe , Ume wbcn 

available at time t 3 . Since the frame grabber has only a single 40 vid ?° frajnc becomes available b stored first 352« to the 

frame buffer, the FRAME2 data is discarded, and not sent to "filmchp" file. The DECspm application begins the audio 

the DECspind application. In this manner, only the freshest dala & ">n& by sending an AUDIOHEADER message (FIG, 

video frame is sent across the network. Regardless of when 15) through the "socket for storage in the "filmchp file, 

the OK message is received after the two frame timeout of ^ t0 } 6K ? ««* of audio data are then stored to 

limit, Lhe last available (and freshest) video frame is sent to 45 tbe fi l mc l l P fiJe immediately following the AUDIO- 

ihe DECspind application, and all other intervening video HEADER message. 

frames are discarded. The last available video frame is sent Next, the frame of available video data is stored 354a to 

shortly after the OK message is received. the "filmclip" file by the DECspin application immediately 

The DECspind application synchronizes the received following the audio data. The DECspin application begins 

audio data stream with the video frame data to be displayed 50 storage of the video frame by first sending a VIDEO- 

bycomparingtheaudiodataslreamtothetimestampsofthe HEADER message (FIG. 16) through the "socket for 

received video frame dala. Due to system time delays and sto rage in the "filmclip" file. A full frame of digitized video 

the order of audio and video dala transmissions, a frame or da ta is then stored to the "filmclip" file immediately follow- 

video will be available for display by the DECspind appli- ™% the V1DEOHEADER message, 

cation prior to- reproduction of its corresponding audio. A 55 Next, the DECspin application determines 355 if it is done 

typical system time delay is about V4 lo second for the storing data to the "filmclip" file. If the DECspin application 

audio signal. Audio data received by the DECspind appli- is done, then it closes 357 the TCP/IP "socket" lo the 

cation is accumulated into a DECspind audio buffer, and "filmclip" file. If the DECspin application has more dala to 

read out for sonic reproduction on a continuous basis. store to the "filmclip" file, the application returns 360a to 

DECspind keeps track of tbe number of audio data bytes 60 determine if a new video frame is available 350a from the 

received from the DECspin application, and thus generates frame grabber buffer, and tbe entire process of storing audio 

a continuously updated audio time stamp. As discussed and video data to the "filmclip" file is repealed, 

above, each video frame is preceded by a VIDEOHEADER FIG. 14(b) shows the resulting structure of the audio and 

(FIG. 16) message which includes a timing information field video data stored in a "filmclip" file 82 by the DECspin 

428 holding a lime stamp value corresponding lo the audio 65 application process of FIG. 14(b), A STARTHEADER dala 

byte count at the end of that video frame time. DECspind block 380 stores the STARTHEADER message first stored 

reads this time stamp information and delays displaying the (316a, FIG, 14(a)) to the "filmclip" file by the DECspin 
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application. Next, an AUDIOHEADER 382 and correspond- 
ing audio data 384 data blocks bold audio buffer data stored 
(352fl) by the DECspin application. Next, a VIDEO- 
HEADER 386 and corresponding video data 388 data blocks 
hold a frame of video data stored (354a) by the DECspin 5 
application. The pattern of AUDIOHEADER 382 H , audio 
data 384„, VIDEOHEADER 386„, and video data 388 M data 
blocks repeat in sequence until the end of the file. 

7b replay the audio and video data from a "filmclip" file, 
the user of the workstation invokes the execution of a 10 
DECspind application. The DECspind application opens a 
TCP/IP "socket" to the "filmclip" file and reads the data 
serially from the file as if receiving the data directly from a 
DECspin application. 

Graphical User Interface is 

FIG. 18 shows a graphical user interface (GUI) window 
510 displayed on the monitor of a workstation 12 (FIG. 2) 
for controlling a DECspin video teleconferencing session. 
Teleconferencing session window 510 is generated by the 
DECspin application using X Windows managed by a Motif 20 
manager, and is displayed as a graphic window on the color 
monitor 30 of the multimedia workstation 12 (FIG. 2). 
DECspin session window 510 provides the user of a net- 
worked multimedia workstation with an interface for access- 
ing the top level video teleconferencing functions of the 
DECspin application. 

When a user invokes the DECspin application to begin a 
video teleconference through, for instance, a UNIX 
command, the DECspin session window 510 appears on the 
workstation color monitor. A window title bar 511 identifies 
the DECspin application and version number to the user. 
From this point on, all teleconferencing functions are 
accessed through the graphical interface associated with this 
and other Motif managed X Windows graphics. 
Furthermore, through this graphical interface, the user can 
also store and playback audio/video "filmclip" messages. 

DECspin application window 510 includes a Motif menu 
bar 512 having a plurality of user selectable "pushbuttons" 
514, 516, 518, 520, and 522. These "pushbuttons" are 
presented as a Motif RowColumn widget which controls all 
the top level DECspin functions available to the user. Each 
of the "pushbuttons" presented to the user through the Motif 
windows are activated with a graphical pointing device such 
as a mouse. A "pushbutton" may for instance be activated by 
moving the mouse to cause a graphical pointer to enter the 45 
area of the pushbutton to select that button, and then 
activating a mechanical switch on the mouse to activate the 
corresponding "pushbutton", Furthermore, the "pushbut- 
tons" also lend themselves to use with a touch screen 
display, where the user simply touches the "pushbutton" on 
the screen to activate it. An activated "pushbutton" is 
highlighted to indicate activation. 

The DECspin graphical user interface has no first or 
second level language specific functional controls, and thus 
DECspin appears to the user as an internationalized appli- 
cation. As such, all top level function pushbuttons 514-522 
of menu bar 512 are identified by iconic symbols which have 
been internationalized where possible. 

Activation of one of the Motif "pushbuttons" of menu bar 



audio message is audibly reproduced which describes the 
function of the selected "pushbutton". 

A live video image appears in a video window 524 
displayed below the menu bar 512. Video window 524 
displays the current local image being generated by the 
frame grabber 34 (FIG. 2) and stored in the video frame 
buffer 36 (i.e., video window 524 frames that section of the 
display memory frame buffer in which the video grabber 
stores each frame of video.) The video window acts as a 
video "monitor" for viewing local video throughout the 
video teleconference session. Furthermore, the size of the 
video window 524 can be changed by using the mouse to 
move a side or corner of the window. Changing the si/e of 
the video window affects the number of pixels encompassed 
by the window, and thus the number of video pixels to be 
sent to another workstation during each video frame. 
Smaller windows achieve a higher frame rate since less data 
per frame must be sent. Conversely, larger windows achieve 
a lower frame rate. Thus, the video frame rale for a video 
conference connection can be adjusted by simply sizing 
video window 524. 

When a called workstation invokes the "slave" DECspind 
application to receive audio and video from a calling DEC- 
spin application, the DECspind application displays a DEC- 
spind session window 850 as shown in FIG. 19. The 
DECspind session window appears similar to the DECspin 
session window 510 of FIG. 18, except that the title bar 852 
displays the identification of the calling party, and the menu 
bar 854 can contain only an "exit" pushbutton 856. A video 
window 858 displays the video data received from the 
DECspin application. Untfte the video window 524 of the 
DECspin session window 510, video window 858 of the 
preferred embodiment is not resizable to change the video 
resolution since its size depends on the resolution of the 
video data sent by the "Master" DECspin application. 
Furthermore, since the video teleconferencing parameters 
are set by the "Master" DECspin application, no functional 
controls are provided other than an "exit" control which 
when activated will terminate the video teleconferencing 
40 connection. As an alternative preferred embodiment, a "con- 
trol" pushbutton can be added to the DECspind session 
window, which when activated offers the user a limited 
control set for adjusting the received video image or audible 
levels. Furthermore, a "monitor** pushbutton can also be 
added to allow the user to monitor, for instance, the data rate 
of the incoming video teleconference associated with the 
DECspind session window. 

Referring again to the DECspin application session win- 
dow 510 of FIG. 18, a functional description of the menu bar 
so 512 "pushbuttons" is as follows. The "exit" pushbutton 514 
when activated forces all video teleconferencing connec- 
tions to the workstation to cease, and for the DECspin 
application to terminate. Any necessary cleanup of network 
connections is also done. If any changes to the DECspin 
configuration occurred during the video teleconference 
session, a pop-up Motif question box (not shown) prompts 
the user to either save the changes, restore default settings, 
or quit. The icon which identifies the "exit" pushbutton 514 
is the international symbol for "exit" (i.e., a green circle with 
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512, in most cases, causes creation of a second level pop-up 60 a vertical white bar on a white background). This symbol is 



window. The second level pop-up window in turn, offers the 
user next level of functional choices associated with the 
selected top level function. 

An audio help, or "talking button", feature is also asso- 
ciated with the Motif "pushbuttons" available for selection 
by the user. By simultaneously selecting a Motif "pushbut- 
ton" while holding down a keyboard "help" key, a stored 



used on all DECspin pop-up windows to indicate the push- 
button that causes the user to exit that particular pop-up 
window. 

The "connections" pushbutton 516 is used to establish 
video teleconference connections between workstations. 
When activated, this pushbutton causes creation of a second 
level "call list" pop-up window 600 as shown in FIG. 20. 
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Through ihe "call list" window the user can add, delete, 
activate or modify network video teleconferencing connec- 
tions to other networked workstations. The user can also 
create and store an audio/video "filmclip" file through this 
pop-up window. The "connections" pushbutton icon is an 
international symbol showing a black grid with four inter- 
section points on a white background. 

The "control" pushbutton 518 is used to adjust various 
parameters associated with the audio and video data gener- 
ated by the workstation and sent to the other video telecon- 
ferencing participants. Activation of this pushbutton causes 
creation of a second level "control" pop-up window 650 as 
shown in FIG. 21. Through the "control" window the user 
can adjust transmission parameters including the maximum 
video frames per second, video hue, video color saturation, 
video brightness, video contrast, audio volume, and micro- 
phone gain. The user can also select between video 
compression, on or off; color or black and white; and, 
transmission source, live or stored. 

The "monitor" pushbutton 520 is used to view various 
teleconferencing and network system parameters. Activation 
of this pushbutton causes creation of a second level "moni- 
tor" pop-up window 700 as shown in FIG. 22. Through the 
"monitor" window, the user can monitor the average video 
frames per second transmission rate, the average network 
resources consumed by the active DECspin video 
teleconference, the number of video conference participants, 
the number of active audio and video connections, and the 
pixel resolution of the video image generated by the local 
workstation. 

The "help" pushbutton 522 is used to access DECspin 
on-line documentation. Activation of this pushbutton causes 
creation of a second level "information" pop-up window 750 
as shown in FIG. 23. Through this help window the user can 
access audio, video and text based information, instruction, 
and help on various DECspin features, indexed by subtopics. 
The "help" pushbutton icon is a blue circle on a white 
background having a white "i" in its center, which is the 
international symbol for "information". . 

Referring to FIG. 20, the "call list" window 600 is 
activated by selecting the "connections" pushbutton 516 
(FIG. 18) of the lop level DECspin session window. The 
"call list" window 600 is a Motif pop-up window which is 
made up mainly of four columns 602, 604, 606 and 608 of 
Motif widgets. Hie widgets of the first column 602 include 
seven "connect" toggle pushbuttons 610a-610g each asso- 
ciated with a "network host" field 612a-612& respectively, 
in the second column 604. To establish a connection with 
another workstation, the user enters the target workstation 
host name and user name into a "network host" field of 
column 604 and activates the corresponding "connect" 
toggle pushbutton of column 602 to establish the connec- 
tion. The syntax for this "host network" field is given as 
"hosl:user" for TCP/IP, and as "host:user" for DECnel, 
respectively. If no user is specified, the DECspin application 
will attempt to contact anyone logged into the targeted host 
workstation, The associated "connect" toggle pushbutton of 
column 602 is activated again to cause disconnection from 
the target workstation. A "connection" icon 614 located 
above the "connect" toggle pushbuttons helps to indicate 
their function to the user. 

The widgets of the third and fourth columns 606, 608 
include seven "audio" toggle pushbuttons 616a-616g and 
seven "video" toggle pushbuttons 618a-618& each associ- 
ated with a "network host" field 612a-612& respectively. 
The "audio" toggle pushbuttons of 616a -616g of column 
606 determine if the associated "network host" will receive 
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audio from the workstation, and the "video" toggle push- 
buttons 618o-618g of column 608 determine if the associ- 
ated "network host" will receive video from the local 
workstation. An "audio" icon 620 indicates the function of 

5 "audio" toggle pushbuttons 616a-616g, and a "video" icon 
622 indicates the function of "video" toggle pushbuttons 
618a-618g. Thus, the user can establish a connection with 
another multimedia workstation (target host) by simply 
indicating the target host name in a "network host" field 612 

to and activating the associated "connect" toggle pushbutton 
610. Once the connection is established, the associated 
"audio" toggle pushbutton 616 determines if the multimedia 
workstation will receive audio, and the associated "video" 
toggle pushbutton 618 determines if the workstation will 

15 receive video. 

Upon activation of a "connect" pushbutton of column 
602, the DECspin application attempts to call the target host 
workstation over the network. If a connection cannot be 
made, a Motif error box (not shown) appears on the local 

20 monitor and states what error has occurred. The error box 
may prompt the user for further instructions, such as retry or 
cancel. 

"Call list" window 600 also includes a "join" pushbutton 
624 which, when activated, joins all "network hosts" cur- 

25 rently connected to the local workstation into a single video 
teleconference. This produces an n-way video teleconfer- 
ence between all the network hosts connected to the work- 
station as indicated by an activated (highlighted) "connect" 
toggle pushbutton 610a-610g. 

30 The "call list" window 600 also allows the user to redirect 
audio and video to and from a multimedia file. An output file 
"connect" toggle pushbutton 626 activates a connection to 
an output file as specified in an associated output file 
descriptor field 628. If an output file connection is activated 

35 while a teleconference is in progress, a copy of the outgoing 
transmission from the local workstation is stored to the 
specified output file. An "audio" toggle pushbutton 630 and 
a "video" toggle pushbutton 632 associated with the output 
file descriptor field 628 respectfully determine if audio, 

40 video, or both audio and video will be stored to the output 
file. The audio and video data is stored to the designated 
output file until the output file "connect" toggle pushbutton 
is deactivated. 

An input file "connect" toggle pushbutton 634 activates 

45 playback of an input file containing pre-recorded audio 
ancVor video data, possibly stored earlier by means of the 
output file "connect" toggle pushbutton discussed above. 
The input file is specified in an input file descriptor field 636 
associated with the input file "connect" toggle pushbutton 

50 634. Furthermore, if the input file is selected for playback 
while a video teleconference is in progress, the contents of 
the file are also sent to the conference members as indicated 
by the active "connect" toggle pushbuttons 610<?-610g. In 
this manner, an audio/video data stream can be sent to and 

55 viewed by all conference members simultaneously. 

A "filmclip" pushbutton 638 allows a user to view DEC- 
spin audio /video messages stored as .SPN files in the con- 
ventional system message area, described below. Activation 
of this pushbutton causes a Motif "file selection box" pop-up 

60 window (not shown) to appear which allows the user to 
select a message file for playback. The message is played 
back by running the stored audio and video data through a 
local DECspind application as if the data streams were being 
sent to the DECspind application by a remote DECspin 

65 application. 

FinaUy, the "exit" pushbutton 640 of "call list" 600 
terminates the "call list" pop-up window and returns the user 
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to the aclive teleconference windows established by means window. Furthermore, the system message area can be 

of the "call list" window. checked for .SPN message files at any time by activating the 

When a call is placed to a target host by activating a "filmclip" pushbutton 638 of the "call list" window 600. 

"connect" toggle pushbutton a "ring box" pop-up window Referring to FIG. 21, the "control" pop-up window 650 is 

800 as shown in FIG, 25 appears on the display of the remote 5 activated by selecting the lop level "control" pushbutton 518 

workstation being called. Simultaneously, the keyboard bell (FIG. 18) of the DECspin session window 510. The "con- 

of the target host workstation is "rung". A DECspind appli- trol" window is a Motif pop-up window which is made up 

cation window 850, shown in FIG. 19, is also displayed on mainly of a column 652 of sliding scale widget controls, and 

the remote workstation, but with inactive video. The "ring a column of corresponding icons 654 and 656 located on 

box" window indicates to the user of the target host work- 10 either side of the sliding scale widgets to indicate the 

station that a video teleconference call is being attempted function of the associated sliding scale widget. For instance, 

with that workstation. The title bar 802 of the "ring box" the top most sliding scale widget 652a adjusts the maximum 

identifies the calling host workstation and the user who video frame rate for the video teleconference. The video 

placed the call. No other information (including audio and frame rate sliding scale widget includes a control gadget 

video) is revealed to the called party unless the call is 15 658a which may be moved with the mouse along the length 

answered. of the sliding scale widget to adjust the maximum frame 

The "ring box" 800 offers the called party an "answer rate. A digital readout 660a above the sliding scale moves 

pushbutton 804 and a "busy" pushbutton 806. If the called with the control gadget and displays the current frame rate 

parly activates the "answer" pushbutton, the target worksta- selling. The left side icon 654a shows a "snail" to indicate 

lion will use a local DECspin application to return audio and 20 movement of the control gadget to the left slows the frame 

video to the calling workstation, and will display the rate. Conversely, the right side icon 656a shows a "hare" to 

received video in the DECspind application window 850 indicate movement of the control gadget to the right 

shown in FIG. 19, The received audio is audibly reproduced increases the frame rate. 

by the DECspind application. This completes the two-way The remaining sliding scale widgets 652fc-652g operate 

video teleconferencing connection between the calling and 25 in a similar manner to effect their respective controls. Scale 

the called workstations. 652M>52g respectively control color hue (red on left, green 

If the called party activates the "busy" pushbutton 806, on right), color saturation, brightness, contrast, audio 

the calling party is informed that the called target worksta- volume, and microphone gain. Furthermore, "control" win- 

tion is busy. Furthermore, the called party can ignore the dow 650 includes two pushbuttons 660 and 661 for enabling 

"ring box". In this case, if there is no answer after a set 30 and disabling video compression, respectively. Two other 

period of lime, e.g., four rings, the calling party is prompted pushbuttons 664 and 666 enable black and white, or color 

to take further action, such as leave a message or close the video, respectively. Finally, an "exit" pushbutton 668 ter- 

call. Still further, the called party can simply "hang up" by minates the "control" window. 

activating the "exit" pushbutton 856 of the DECspind appli- Referring to FIG. 22, the "monitor" pop-up window 700, 

cation window of FIG. 19. 35 activated by selecting the top level "monitor" pushbutton 

If a called party does not answer within a predetermined 520 (FIG. 18) of the DEcspin application window 510. The 

time period, answers busy, or just hangs up, the calling party "monitor" window is a Motif pop-up window which 

is prompted with a Motif information box (not shown) includes graphic indicators for displaying certain video 

which allows the caller to leave a short audio/video message teleconferencing parameters and statistics. The displayed 

on the called workstation. This feature works like an answer- 40 statistics are updated periodically, for instance, every five 

ing machine. Alternatively, the caller can be shown a "greet- seconds. 

ings filmclip" previously stored by the called party which Information related to ihe video image generated by the 

asks the caller to leave an audio/video message on the called DECspin application is displayed below a "camera" icon 

workstation. 702. The video image information includes a digital readout 

The maximum length of the message is preset to a 45 704 of the video image size in horizontal by vertical pixels, 

reasonable period of time, dependent on the file storage and a sliding scale indicator 706 with an associated digital 

resources of the target system. In one preferred embodiment, readout 708 for showing the average frame rate. These two 

the maximum message length is limited to 20 seconds, and parameters are important since the DECspin video window 

is not changeable by the user. The user is presented with a 524 of FIG. 18 may be "sized", as discussed above, to 

pop-up Motif "countdown" box (not shown) which provides 50 change the number of pixels contained in the image, Chang- 

a running indication of the amount of time left while leaving ing the number of pixels also effects the video frame rate, 

a message. Both these video parameters can be monitored by these 

Messages may be stored in the conventional system indicators as the DECspin window is sized, 
message area with, for instance, a .SPN file descriptor Information related to the network and active video 
extension. Once the caller elects to leave an audio/video 55 teleconference is displayed by indicators located below a 
message, the DECspin application of the calling workstation "connection" icon 710. This information includes digital 
directs the audio and video data streams meant for the called readouts of the total number of active teleconferencing 
workstation to a message "filmstrip" file. Upon invocation connections 712, the number of active audio connections 
of the DECspin application, the system message area is 714, and number of active video connections 716. Finally, a 
checked for any stored .SPN message files. If any are 60 sliding indicator 718 and an associated digital readout 720 
present, the user is presented with a pop-up Motif "file display the average network consumption. An "exit" push- 
selection box" window (not shown) which allows the user to button 722 terminates the "monitor** pop-up window, 
select and playback any of the stored messages. The mes- Referring to FIG. 23, the "information" pop-up window 
sage is played back by running the stored audio and video 750 is activated by selecting the "help" pushbutton 522 
data streams through a DECspind application as if the data 65 (FIG. 18) of the top level DECspin session window 510 and 
streams were being sent by an active DECspin application. allows the user access to textual and "filmclip" documen- 
Message files may also be discarded through this pop-up tation for the DECspin application. The "information" win- 
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dow is a second level Motif pop-up window which is made 
up of a column 752 of user selectable pushbuttons config- 
ured as a Motif Radio Box so that only a single pushbutton 
can be activated at one time. Each pushbutton is labeled with 
a sub-topic for which help documentation is available. For 
instance, in the embodiment of FIG. 23, help documentation 
is available to provide an overview of the video teleconfer- 
encing system 754, to help start a conference 756, to help 
with a specific video teleconferencing feature 758, or to help 
troubleshoot a video teleconferencing problem 760. Upon 
activation of one of the topic pushbuttons, a third level 
"sub-help" window 780 of FIG. 24 appears offering the user 
a further breakdown of subjects related to the selected topic. 
For instance, the "sub-help" window of FIG. 24 shows the 
subjects available to the user after selecting the overview 
pushbutton 754 of FIG. 23. 

The "sub-help" window 780 of FIG. 24 is a third level 
Motif pop-up window having a column of pushbuttons 782 
and 784 on each side of a center column 786 of subjeel 
labels. The left column of pushbuttons 782 activates a 
bookreader textual documentation system for the corre- 
sponding subject For instance, activation of pushbutton 788 
will present the user with text on the workstation display 
describing an introduction to the video teleconferencing 
system. The right column of pushbuttons 784 activates a 
"filmclip" for the corresponding subject. For instance, acti- 
vation of pushbutton 790 will open another DECspind 
window on the display through which a "filmclip" demon- 
stration will be played back to the user. 

Hie help system thus described offers the user three levels 
of comprehensive textual, audio and visual system docu- 
mentation. At the first level, the "talking keys" offer the user 
quick access to audio information about a function available 
for selection by the user. At the second level, the pop-up 



10 



15 



30 



user of Workstation A has activated the "call list" window 
600a, the "control" window 650a, and the "monitor" win- 
dow 700a. 

The user of Workstation A initiates a video teleconference 
call to Workstation B ("host B") by activating pushbutton 
610a of the "call list" window. FIG. 26(b) shows the display 
306 of Workstation B after Workstation A places the call. A 
"ring box" 800a and a blank DECspind session window 
850a, identifying the calling party ("host A") appear on the 
Workstation B display. The user of Workstation B answers 
the video teleconference call by activating the answer push- 
button of "ring box" 800a. 

FIG. 26(c) shows the display 306 of Workstation B afler 
the user answers the call from Workstation A. Here, the 
video (and audio) of the host A DECspind session window 
850a has been activated. Further, a local DECspin session 
window 5106 appears to allow the user of Workstation B to 
monitor the local video signal. Here also, the user of 
Workstation B has invoked the "control" window 6506 from 
the DECspin session Window 5106. FIG. 26(d) shows the 
display of Workstation A after Workstation B has answered 
the video teleconference call. A host B DECspind window 
8506 provides return video from Workstation B to Work- 
station A. 

The user of Workstation A initiates a video teleconference 
call to another user on Workstation C ("host C") by acti- 
vating pushbutton 6106 of the "call list" window 600a. 

FIGS. 26(e) and 26(f) show the display 30c of Worksta- 
tion C after Workstation A places the call, and after Work- 
station C answers the call, respectively. Here again, the user 
answering the call to Workstation C causes the invocation of 
a local DECspin session window 510c to monitor local 
video from Workstation C, FIG. 26(g) shows the display 30a 
of Workstation A afler the user of Workstation C answers the 



"information" window helps to narrow the user's help 35 call. A host C DECspind session widow 850c displays the 



requirements to a specific topic. At the third level, the 
pop-up "sub-help" window offers the user textual and/or 
audio/visual documentation on a variety of subjects related 
to the selected second level topic. 

Furthermore, the file storage structure for the help docu- 
mentation adds a high degree of flexibility to the audio/ 
visual documentation system of this invention. For instance, 
each "audio clip" of the "talking key" help function is stored 
in a separate key-specific file which is played bade when the 
talking help function is activated. Thus, if the function of a 
key changes, only a single audio file needs to be updated. 
Furthermore, the audio help system can be easily interna- 
tionalized by providing an "audio clip" file set correspond- 
ing to the desired foreign language. This also applied to the 
textual and "filmclip" documentation which is stored in 
separate subject-specific files. Thus, if a system function 
changes, only the text and/or "filmclip" files affected by the 
change need to be updated. Although this audio/visual 
documentation system has been described with reference to 
the video teleconferencing application of this invention, it 
will be apparent to those skilled in the art that such an audio 
and/or visual help system can be provided on a multi-media 
workstation or PC for virtually any type of application. 

FIGS, 26(a)-26(k) show the display screens of three 
workstations, Workstation A(30«), Workstation B (306), and 
Workstation C (30c) during the initiation of a typical three- 
way video teleconference using the Graphical User Interface 
of Ibis invention. FIG. 26(a) shows a typical display 30a for 
Workstation A after the DECspin application has been 
invoked but before the initiation of a video teleconference. 
This display shows a DECspin session window 510a for 
monitoring the local video generated by Workstation A. The 
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return video from Workstation C to Workstation A. 

At this point the user of Workstation A can join the users 
of Workstation B and Workstation C into a three-way 
conference by activating the "join" pushbutton 624 of the 
"call list" window 600a. Upon activation of the "join" 
pushbutton, Workstation B is caused to place a video tele- 
conference call to Workstation C, and vice versa. FIGS. 
26(h) and 26(t) show the display of Workstation B and 
Workstation C, respectively, after the call is placed, but 
before it is answered, A "ring box" and blank DECspind 
application session window from Workstation C (800c and 
850c) appear on the display of Workstation B (FIG, 26(h)) 
and a "ring box" and blank DECspind application session 
window from Workstation B (8006 and 8506) appear on the 
50 display of Workstation C (FIG. 26(/)). 

FIGS. 26(j) and 26(h) show the display of Workstation B 
and Workstation C, respectively, after the user of each 
workstation has answered their respective "ring box" of 
FIGS. 26(a) and 26(1). Thus, FIGS. 26(g), 26(j) and 26(k) 
55 show the resulting display of Workstations A, B, and C, 
respectively, when all are joined into a three-way video 
teleconference. 

Pixel Decimation and Replication 

FIG. 27 shows a flowchart of a process for implementing 
the Pixel Decimation and Replication (PDR) video com- 
pression technique of this invention. This technique is 
especially attractive as an inexpensive alternative to video 
compression techniques, such as JPEG or MPEG, which 
typically require dedicated hardware support. 

Specifically, the frame grabber 34 (FIG. 2) Captures 550 
a video frame in the video buffer 35 (FIG. 2), and proceeds 
to scale 552 by V4 the video data in the horizontal and 
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vertical directions. la the preferred embodiment, the scaling 
is accomplished by a mechanism internal to the particular 
video grabber in response to a "scale** command. However, 
generally, the scaling can be accomplished by producing a 
"scaled" pixel based on the contents of the pixels it replaces, 5 
e.g., by implementing a pixel averaging function. 

In its simplest form, the scaling can be accomplished by 
discarding every other pixel along a horizontal line, and 
every other entire horizontal line. FIG. 28(a) show a picto- 
rial representation of a video frame 580 measuring 480 10 
vertical (V) pixels by 680 horizontal (H) pixels. An "X" in 
the pixel indicates that it is eliminated from the video frame. 
The resulting scaled video frame 582 is shown in FIG. 2S(b) 
and has 240 vertical pixels by 320 horizontal pixels, or V* the 
quantity of original pixels. is 

The resulting scaled video frame 582 is then made avail- 
able to the DECspin application for transmission 554 across 
the network to a remote workstation. Hie remote worksta- 
tion receives 556 the scaled video frame with a DECspind 
application. The DEcspind application proceeds to recon- 20 
struct a 480 by 640 pixel video frame 584 as shown in FIG, 
28(c) from the received scaled video frame. First the DEC- 
spind application replicates each scaled pixel along a hori- 
zontal line to produce 640 pixels along a line. For instance, 
the (1,1) pixel of the original unsealed video frame 580 of 25 
FIG. 28(a), where the notation is given as (V,H), is relocated 
to the (1,1) position and replicated to the (1,2) position of the 
reconstructed video frame 584 of FIG. 28(c). Similarly, the 
(1,3) pixel of the original frame 580 is relocated to the (1,3) 
position and replicated to the (1,4) position of the recon- 30 
structed frame 584. 

Next, when an entire line of pixels has been reconstructed, 
that line is replicated 560, shifted 562 by one pixel and 
stored as the next adjacent vertical line in the reconstructed 
video frame. For example, as shown in FIG. 28(c), the 35 
reconstructed pixels from the first horizontal line (V»l) are 
replicated to the second horizontal line (V=2) and shifted by 
1 pixel to the right. Thus, for example pixel (1,1) of the 
original video frame 580 is replicated into positions (2,2) 
and (23) of the reconstructed video frame 584, and pixel 40 
(1,3) of the original video frame 580 is replicated into 
positions (2,4) and (2,5) of the reconstructed video frame 
584. It should be noted that the pixel 00 the left end of a 
replicated line (V=2) can be left blank (black), filled with a 
pre-determined color or grey level, or filled with yet another 45 
replication of the next adjacent pixel. On the other band, the 
last pixel on a replicated line will only be reproduced once. 
These results will be reversed if the replicated line is shifted 
to the left by one pixel, rather than to the right as assumed 
in the above example. 50 

Finally, the pixel and line replication process is repeated 
566 for each line of scaled video data received by the 
DECspind application. When the DECspind application is 
done 564 reconstructing the entire scaled video frame, the 
reconstructed frame is made available for display 568 by the 55 
DECspind application. It should be noted that an analogous 
reconstruction technique that replicates pixels along a ver- 
tical column as just described for pixels along a horizontal 
line, and replicates and shifts vertical pixel columns as just 
described for horizontal lines, produces similar results. The go 
DECspind application displays the reconstructed video 
frame in a DECspind application window synchronized to 
the audio data stream in a manner described above. 
Equivalents 

While this invention has been particularly shown and 65 
described with references to preferred embodiments thereof, 
it will be understood by those skilled in the art that various 
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changes in form and details may be made therein without 
departing from the spirit and scope of the invention as 
defined by the appended claims. For example, although the 
audio/video "fllmclip" storage and retrieval features of this 
invention have been described with reference to a video 
teleconferencing application, these "filmclip" features arc 
not limited to video teleconferencing applications. Rather, 
these features can be used generally for storage and retrieval 
of audio and/or video on a multimedia workstation or 
personal computer system. 
What is claimed is: 

1. A method for storing and retrieving audio and video 
data on a multimedia workstation, comprising the steps of 

a) storing an audio data stream from a workstation to a 
data file accessible by the workstation such that the 
audio data stream can be retrieved from the data file and 
reconstructed by the workstation into a continuous 
audio signal; 

b) storing a non-continuous logical stream of video data 
from the workstation to the data file such that each 
frame of video data stored to the data file is inserted 
into the audio data stream also stored in the data file by 
the workstation without affecting the continuity of the 
audio signal when later retrieved from the data file and 
reconstructed by the workstation, said noncontinuous 
logical stream of video data being available video data 
remaining after portions of an initial video data stream 
have been discarded, while the audio data stream as 
stored in the data file remains unbroken; and 

c) attaching timing information to each frame of video 
data stored to the data file indicating a point in the audio 
data stream also stored to the data file which corre- 
sponds in time to the frame of video data, such that the 
stored available video data in the form of a noncon- 
tinuous logical stream of video data is realigned with 
the stored unbroken audio data stream. 

2. A method for storing and retrieving audio and video 
data as described in claim 1 wherein the non-continuous 
video data results from network congestion. 

3. The method of claim 1 further comprising the step of 
displaying a frame of video data, retrieved from the data 

file, on the display of the workstation when the point in 
the audio data stream, retrieved from the data file, 
corresponding to the timing information of the 
retrieved video frame is audibly reproduced by the 
workstation. 

4. The method of claim 3 further comprising the steps of 

a) the workstation internally generating timing informa- 
tion by counting the amount of audio data in the audio 
stream retrieved from the data file; and 

b) the workstation comparing the internally generated 
timing information with the timing information stored 
in the data file corresponding to the frame of video data 
most recently retrieved from the data file to determine 
when to display the most recently retrieved frame of 
video data on the display of the workstation. 

5. A multimedia workstation, comprising: 

a) storage means for a workstation to store a stream of 
audio data packages and a corresponding non- 
continuous logical stream of video data as digital data 
packets to a data file accessible by the workstation as 
audio and video data packets, the video packets includ- 
ing timing information such that the stored available 
video data in the form of a noncontinuous logical 
stream of video data can be realigned with a stored 
unbroken audio data stream, said noncontinuous logical 
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stream of video data being available video data remain- 
ing after portions of ao initial video data stream have 
been discarded, while the audio data stream as stored in 
the data file remains unbroken; and 
b) retrieval means for the workstation to retrieve audio 5 
and video data from the data file which was stored as 
digital data packets by the storage means. 

6. A multimedia workstation as described in claim 5 
wherein the non-continuous video data results from network 
congestion. 10 

7. The multimedia workstation of claim 5 ( wherein . 
the retrieval means retrieves the data packets from the 

data file and reconstructs the audio and video data 
stored by the storage process for audible and visual 
reproduction, respectively. 15 

8. The multimedia workstation of claim 7 wherein 

a) the storage means further comprises means for attach- 
ing timing information to each frame of video data 
stored to the data file indicating a point in the audio data 2(J 
stream also stored to the data file which corresponds in 
time to the frame of video data; and 

b) the retrieval means further comprises synchronization 
means for displaying a frame of video data, retrieved 
from the data file, on the display of the workstation 2 5 
when the point in the audio data stream, retrieved from 
the data file, corresponding to the timing information of 
the retrieved video frame is audibly reproduced by the 
workstation. 

9. The multimedia workstation of claim 8 wherein 30 

a) the retrieval means further comprises timing means for 
generating timing information by counting the amount 
of audio data in the audio stream retrieved from the data 
file; and 

b) the synchronization means further comprises compari- 35 
son means for comparing the internally generated tim- 
ing information with the timing information stored in 
the data file corresponding to the frame of video data 
most recently retrieved from the data file to determine 
when to display the most recently retrieved frame of 40 
video data on the display of the workstation. 

10. The multimedia workstation of claim 5 wherein the 
data file is accessed using a TCP/IP protocol data socket. 

U. A multimedia computer workstation, comprising 
a video source that provides sequential frames of digitized 45 
video data; 

an audio source that provides a digitized audio data 
stream that represents a continuous audio signal syn- 
chronized to the sequential frames of digitized video 5(J 
data; 

data storage capable of storing a non-continuous logical 
stream of video data with a corresponding stream of 
audio data to a data file such that each frame of video 
data stored to the data file is sequentially inserted into 55 
the audio data stream without affecting the continuity 
of the audio signal represented by the audio data 
stream, said noncontinuous logical stream of video data 
being available video data remaining after portions of 
an initial video data stream have been discarded, while 60 
the audio data stream as stored in the data file remains 
unbroken; 

means for audibly reproducing retrieved audio data 
stream into a continuous audio signal; and 

a display thai displays retrieved sequential frames of 65 
video data on the display of the workstation synchro- 
nized to the reproduced audio signal such that the 
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stored available video data in the form of a noncon- 
tinuous logical stream of video data is realigned with 
the stored unbroken audio data stream. 

12. The multimedia workstation of claim 11, wherein the 
video source comprises a video camera providing sequential 
frames of live analog video, and frame capture device for 
capturing, digitizing, and storing each sequential frame of 
live analog video. 

13. The multimedia workstation of claim 11, wherein the 
video source comprises means for providing pre-recorded 
sequential frames of analog video, and frame capture means 
for capturing, digitizing, and storing each sequential frame 
of pre-recorded analog video. 

14. The multimedia workstation of claim 13, wherein the 
video source comprises a video tape recorder. 

15. The multimedia workstation of claim 13, wherein the 
video source comprises a video laser disk player. 

16. The multimedia workstation of claim 11 wherein the 
audio source comprises a microphone for transducing live 
audio into an analog audio signal, and audio digitizer and 
storage for digitizing and storing the analog signal. 

17. The multimedia workstation of claim 16 wherein the 
audio digitizer and storage applies mu-Iaw compression in 
digitizing the analog audio signal. 

18. The multimedia workstation of claim 11 wherein the 
audio source comprises means for providing pre-recorded 
audio signals corresponding to sequential frames of pre- 
recorded video. 

19. The multimedia workstation of claim 11 wherein the 
data file is accessed using a TCP/IP protocol data socket. 

20. The multimedia workstation of claim 11 wherein the 
storage comprises video compressor for reducing the quan- 
tity of data required to be stored to the data file to represent 
each frame of video data. 

21. The multimedia workstation of claim 20 wherein the 
video compressor applies JPEG compression to the video 
data. 

22. The multimedia workstation of claim 20 wherein the 
video compressor applies MPEG compression to the video 
data. 

23. The multimedia workstation of claim 11 wherein the 
workstation comprises an IBM compatible personal com- 
puter. 

24. The multimedia workstation of claim 11 wherein the 
workstation comprises a RISC processor. 

25. A multimedia computer workstation as described in 
claim 11 wherein the non-continuous video data results from 
network congestion. 

26. A method of processing audio/video data information, 
the method comprising the steps of: 

capturing time-related audio and video data for transmis- 
sion over a logical connection between two worksta- 
tions coupled to a network; 

at a transmitting workstation, digitizing the audio and 
video data into packets for transmission over a logical 
connection to a target workstation; 

transmitting timing information to the target workstation 
for reconstructing the time-related audio and video data 
transmitted over the logical connection; and 

monitoring a throughput capacity of the network and 
discontinuing transmission of a logical stream of the 
video data during periods of congestion, yet continuing 
to transmit a sensibly continuous logical stream of 
audio data for reconstruction at the target workstation, 
said timing information enabling realignment of avail- 
able transmitted video data with the transmitted con- 
tinuous audio data. 
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27. A method as in claim 26, wherein each of the 34. A method as in claim 26 t wherein the video data is 
workstations is capable of sonically reproducing the audio video frame information digitized into data packets corn- 
data and visually reproducing video data received from prising less than 32 kilobits of data. 

another workstation. 35. a method as in claim 26 further comprising the steps 

28. A method as in claim 26, wherein the transmitting 5 0 f : 

workstation discontinues transmission of video data if a discardiDg video data when network congestion is 

digitized block of video information is not transmitted over j * * j .i_ , *j j . u . *«. * . 

*i_ i ml* -c j . -j detected so that newer video data can be transmitted to 

the network within a specified timeout period. , 

29. A method as in claim 26, wherein the audio and video ' h f target workstation. t t 

data is initially encoded based on an HTSC (National 10 method as in claim 35 further comprising the steps 
Television System Committee) standard that is converted to 

digital data packets for transmission over the network. at the target workstation, synchronizing a playback of 

30. A method as in claim 26, wherein the audio and video received audio data with received video data regardless 
data is transmitted to a target workstation based on a TCP/IP of whether video data is discarded. 

protocol. 15 37. A method as in claim 26 further comprising: 

31. A method as in claim 26 further comprising the step storing the audio and video data in memory. 

of: 38. A method as in claim 26, wherein a transmission of 

receiving the audio and video data at the target worksta- audio and video data over a logical connection of the 

tion and reconstructing an originally captured image network supports a teleconference session, 

and sound for a user. 20 39. A method as in claim 26 further comprising: 

32. A method as in claim 26, wherein the audio and video continuing transmission of a logical steam of video data 
data sent across the network includes frames of video when a logical connection supports appropriate 
information inserted into a sensibly continuous stream of throughput. 

audio data. 40. A method as in claim 39, wherein the video data is 

33. A method as in claim 26, wherein the target worksta- 25 current video data, 
tion plays the sensibly continuous audio stream and time- 
related corresponding received frames of video data. * * * * * 
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